-- Logs begin at Fri 2022-05-13 13:10:52 UTC, end at Fri 2022-05-13 14:15:35 UTC. -- May 13 13:46:16.856538 dv-cinder-841753-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:46:16.865611 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:46:16 2022] *** May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: nodename: dv-cinder-841753-1-iscsi May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: machine: x86_64 May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: clock source: unix May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: pcre jit disabled May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: detected number of CPU cores: 4 May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: current working directory: / May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: detected binary path: /usr/bin/uwsgi-core May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: your processes number limit is 47680 May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: your memory page size is 4096 bytes May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: detected max file descriptor number: 2048 May 13 13:46:16.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: lock engine: pthread robust mutexes May 13 13:46:16.869460 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: thunder lock: enabled May 13 13:46:16.869460 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:46:16.869460 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:46:16.914096 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: Python main interpreter initialized at 0x556b93ca09c0 May 13 13:46:16.914096 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: python threads support enabled May 13 13:46:16.914096 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: your server socket listen backlog is limited to 100 connections May 13 13:46:16.914096 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: your mercy for graceful operations on workers is 90 seconds May 13 13:46:16.914534 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:46:16.914534 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: *** Operational MODE: preforking *** May 13 13:46:16.914853 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: *** uWSGI is running in multiple interpreter mode *** May 13 13:46:16.914853 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: spawned uWSGI master process (pid: 109134) May 13 13:46:16.915118 dv-cinder-841753-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:46:16.918226 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: spawned uWSGI worker 1 (pid: 109135, cores: 1) May 13 13:46:16.918226 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: spawned uWSGI worker 2 (pid: 109136, cores: 1) May 13 13:46:16.918226 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:46:18.170138 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:46:18.192903 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:46:18.926841 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:46:18.926841 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: from cryptography.utils import int_from_bytes May 13 13:46:18.927163 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:46:18.927163 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: from cryptography.utils import int_from_bytes May 13 13:46:18.930212 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:46:18.930212 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: from cryptography.utils import int_from_bytes May 13 13:46:18.930543 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:46:18.930543 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: from cryptography.utils import int_from_bytes May 13 13:46:21.596951 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:46:21.597535 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:46:21.597725 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:46:21.598074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:46:21.598323 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:46:21.598732 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.599234 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.599552 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.599867 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.600196 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.600502 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.600818 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.601183 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.601538 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.601826 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.602314 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.602644 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-1-iscsi {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.603073 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.603408 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.603722 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.604037 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.604335 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.604653 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.604955 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.605256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:46:21.605772 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.605975 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:46:21.606158 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.606158 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.606462 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.606668 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:46:21.606837 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.607136 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.607330 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:46:21.607492 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.607734 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.607894 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:46:21.608043 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.608256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.608429 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.608595 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.608738 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.608893 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.609044 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-1-iscsi {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.609256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.609406 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.609615 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.609839 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.609977 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.610322 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.610451 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.610628 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.611989 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.612145 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.612145 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.612409 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.612525 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.612709 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.612914 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.613258 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.613497 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.613718 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.613917 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.613917 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.614309 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-1-iscsi {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.614521 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.614778 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.614778 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.615195 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.615416 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.615581 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.615581 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.615849 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.615984 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616117 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616243 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616377 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616511 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616637 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616781 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.616781 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617037 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617182 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617182 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617429 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617572 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617572 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.617882 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.618091 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.618091 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.618500 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.618664 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.618664 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.618974 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619108 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619108 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619392 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619534 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619672 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619799 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.619799 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620046 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620171 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620171 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620417 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620543 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620543 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620777 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.620902 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.621038 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.621205 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.621344 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.621719 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.621958 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-1-iscsi {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.622175 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.622375 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.622593 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.622809 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.622951 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623088 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623232 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623232 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623587 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623724 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623866 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.623991 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.624116 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.624349 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.624484 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.624648 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.624922 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.625055 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.625261 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.625437 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.625566 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.625794 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.625941 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.626092 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.626390 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.626529 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.626700 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.626970 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.627133 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.627307 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.627437 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.627609 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.627738 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.627903 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628032 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628203 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628353 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628561 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628700 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628868 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.628998 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.629167 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.629319 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.629480 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.629652 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.629840 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630010 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630188 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630358 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630487 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630603 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630769 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.630940 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631058 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631258 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631376 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631526 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631638 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631826 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.631952 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.632149 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.632772 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.632973 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.633153 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.633335 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.633528 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.633804 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634007 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634162 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634291 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634416 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634553 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634671 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634823 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.634964 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635114 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635243 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635375 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635501 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635634 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635771 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.635906 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.636032 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.636190 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.636364 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.636550 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.636721 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.636891 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637068 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637221 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637357 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637497 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637613 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637737 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637863 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.637993 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638119 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638253 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638503 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638634 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638837 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.638970 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.639138 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.639277 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.639438 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.639567 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.639734 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.639873 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640046 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640168 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640363 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640499 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640679 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640822 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.640982 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641121 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641260 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641392 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641525 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641664 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641822 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.641954 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.642144 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.642281 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.642454 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.642593 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.642786 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.642910 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.643101 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.643235 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.643403 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.643534 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.643712 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.643941 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.644083 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.644210 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.644334 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.644461 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.644613 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.644742 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.644921 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.645058 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.645230 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.645360 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.645540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.645676 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.645849 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.645986 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.646157 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.646288 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.646477 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.646590 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.646813 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.646959 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.647123 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.647265 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.647431 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.647568 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.647735 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.647915 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.648632 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.648823 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.648962 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.649260 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.649390 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.649591 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.649724 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.649884 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.650013 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.650195 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.650323 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.650506 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.650636 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.650854 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.650998 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.651168 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.651317 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.651495 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.651633 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.651786 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.651926 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.652090 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.652221 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.652402 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.652532 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.652721 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.652850 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.653030 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.653248 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.653376 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.653501 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.653626 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.653751 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.654179 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.654440 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.654542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.654640 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.654769 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.654891 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.654891 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.655063 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.655177 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.655433 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.655518 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.655596 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.655851 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.656076 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.656172 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.656253 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.656421 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.656509 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.656730 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.656826 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.657070 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.657176 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.657346 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.657434 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:46:21.657653 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.657753 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.657954 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658049 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658251 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658337 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658549 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658645 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658900 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.658989 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.659200 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.659310 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.659516 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.659635 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.659917 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660019 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660144 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660475 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660574 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660776 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.660894 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.661085 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.661211 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.661392 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.661528 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.661699 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.661849 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662001 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662172 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662308 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662548 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662648 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662852 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.662931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.663194 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.663288 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.663524 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.663602 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.663841 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.663926 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.664163 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.664239 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.664465 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.664549 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.664888 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.664987 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665084 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665166 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665366 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665467 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665673 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665778 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.665981 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.666068 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.666289 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.666383 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.666606 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.666730 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.666955 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.667042 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.667264 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.667352 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.667596 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.667691 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.667920 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668005 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668225 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668320 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668542 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668642 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668867 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.668960 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.669176 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.669261 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.669475 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.669569 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.669779 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.669865 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.670077 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.670165 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.670378 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.670498 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.670677 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.670791 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671003 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671090 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671301 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671394 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671601 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671687 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671899 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.671992 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.672197 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.672285 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.672495 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.672583 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.672809 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.672910 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.673112 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.673199 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.673412 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.673512 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.673740 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.673835 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.674056 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.674143 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.674364 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.674458 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.674690 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.674866 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675039 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675127 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675354 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675448 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675693 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675903 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.675992 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.676227 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.676313 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.676539 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.676626 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.676853 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.676950 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.677735 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.677845 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.677845 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.677979 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678048 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678121 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678187 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678252 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678411 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678497 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678740 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.678834 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.679072 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.679175 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.679407 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.679496 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.679724 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.679823 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680029 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680109 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680348 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680437 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680705 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680794 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.680981 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.681077 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.681294 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.681397 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.681608 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.681696 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.681928 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682015 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682245 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682332 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682554 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682641 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682890 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.682979 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.683197 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.683293 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.683510 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.683644 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.683818 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.683915 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.684124 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.684218 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.684436 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.684527 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.684742 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.684860 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685068 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685163 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685355 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685447 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685671 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685771 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.685974 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.686065 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.686286 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.686384 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.686583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.686682 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.686917 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687113 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687257 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687396 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687572 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687723 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687860 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.687993 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.688169 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.688312 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.688489 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.688631 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.688793 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.688924 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.689098 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.689229 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.689402 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.689538 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.689703 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.689834 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690004 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690140 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690308 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690445 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690614 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690792 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.690948 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.691036 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.691253 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.691343 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.691553 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.691662 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.692133 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.692242 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.692559 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.692719 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.692859 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.692991 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.693156 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.693244 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.693460 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.693562 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.693778 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.693875 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.694080 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.694167 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.694396 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.694535 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.695250 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.695393 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.695569 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.695671 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.695869 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.695964 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.696185 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.696272 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.696489 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.696586 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.696787 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.696874 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.697085 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.697172 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.697383 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.697470 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.697716 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.697835 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698021 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698112 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698323 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698417 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698635 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698744 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.698982 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699070 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699287 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699375 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699599 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699686 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699903 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.699990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.700206 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.700293 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.700520 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.700608 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.700828 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.700961 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.701134 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.701221 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.701444 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.701546 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.701744 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.701847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702048 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702137 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702354 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702466 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702670 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702831 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.702999 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.703086 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.703304 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.703394 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.703608 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.703703 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.703907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.704006 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.704209 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.704322 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.704538 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.704639 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.704940 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.705102 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.705256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.705510 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.705688 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.705774 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.705866 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.706047 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.706162 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.706365 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.706476 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.706675 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.706807 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707024 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707111 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707348 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707446 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707721 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707832 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.707993 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.708091 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.708301 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.708400 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.708606 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.708694 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.708912 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709007 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709218 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709305 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709520 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709608 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709822 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.709909 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.710127 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.710237 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711084 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711221 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711339 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711568 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711669 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711806 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.711967 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.712107 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.712276 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.712410 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.712585 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.712723 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.712894 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713025 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713242 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713329 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713557 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713653 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713866 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.713976 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.714199 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.714354 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.714536 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.714639 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.714845 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.714946 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.715146 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.715240 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.715468 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.715597 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.715775 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.715877 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.716100 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.716199 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.716441 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.716702 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.716791 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.716870 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717024 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717113 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717322 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717416 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717634 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717727 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.717933 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718029 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718234 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718329 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718533 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718622 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718867 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.718976 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.719173 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.719261 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.719472 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.719607 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.719777 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.719863 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.720081 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.720170 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.720387 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.720669 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.720765 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.720976 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721063 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721286 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721412 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721589 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721693 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721901 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.721991 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.722205 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.722300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.722504 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.722609 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.722833 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.722940 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.723141 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.723236 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.723443 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.723546 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.723744 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.723838 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724047 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724149 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724344 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724438 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724656 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724750 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.724956 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.725050 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.725256 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.725501 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.725620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.725823 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.725919 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.726205 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.726306 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.726466 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.726563 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.726843 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.726936 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.727142 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.727243 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.727444 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.727529 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.727811 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.727944 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728078 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728165 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728335 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728423 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728639 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728725 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.728946 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.729043 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.729261 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.729358 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.729571 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.729677 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.729866 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730034 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730172 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730267 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730469 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730555 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730793 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.730898 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731094 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731182 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731556 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731696 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731785 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731876 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.731968 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.732124 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.732264 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.732494 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.732601 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.732765 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.732861 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.733076 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.733170 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.733387 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.733483 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.733697 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.733898 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.734014 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.734202 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.734329 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.734525 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.734650 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.734871 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.735035 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.735156 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.735244 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.735515 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.735614 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.735818 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736008 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736215 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736440 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736528 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736744 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.736829 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737052 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737195 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737356 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737464 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737654 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737767 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.737954 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738064 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738260 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738365 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738570 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738656 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738894 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.738996 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.739194 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.739288 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.739498 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.739597 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.739802 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.739897 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.740107 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.740194 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.740413 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.740507 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.740721 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.740818 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.741038 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.741124 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.741338 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.741429 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.742184 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.742322 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.742487 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.742582 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.742816 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.742907 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.743122 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.743222 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.743427 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.743514 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.743732 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.743818 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744037 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744124 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744341 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744428 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744650 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744795 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.744975 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.745119 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.745291 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.745379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.745599 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.745705 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.745910 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746001 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746217 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746304 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746530 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746643 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746855 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.746983 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.747168 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.747257 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.747472 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.747570 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.749993 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750122 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750122 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750289 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750385 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750468 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750547 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750633 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750765 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750851 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.750945 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751029 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751109 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751200 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751336 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751426 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751516 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751598 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751673 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751747 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751834 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751914 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.751914 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752073 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752073 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752225 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752293 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752358 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752432 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752512 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752598 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752678 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752757 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752843 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.752999 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.753086 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.753302 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.753388 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.753617 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.753716 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.753915 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754002 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754215 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754302 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754514 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754610 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754843 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.754990 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.755167 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.755294 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.755482 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.755613 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.755796 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.756020 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.756106 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.756345 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.756442 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.756629 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.756741 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.757034 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.757128 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.759980 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760124 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760124 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760281 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760362 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760441 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760520 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760608 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760608 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760763 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760763 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760915 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.760995 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761152 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761236 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761322 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761403 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761482 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761575 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761657 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761735 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761803 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761869 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.761934 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762024 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762105 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762193 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762274 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762353 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762420 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762499 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762567 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762729 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.762821 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.763090 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.763189 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.763400 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.763488 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.763727 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.763814 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764036 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764131 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764353 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764484 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764656 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764801 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.764955 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.765115 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.765261 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.765426 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.765549 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.765741 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.765851 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.766056 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.766166 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.766376 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.766463 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.766693 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.766805 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767021 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767120 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767370 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767522 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767671 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767817 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.767969 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.768110 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.768268 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.768407 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.768557 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.768703 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.768846 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769001 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769147 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769286 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769428 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769589 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769729 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.769911 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770021 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770146 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770340 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770502 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770639 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770877 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.770969 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.771050 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.771238 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.771327 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.771535 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.771751 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.771868 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.772069 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.772163 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.772377 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.772473 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.772795 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.772975 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.773132 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.773310 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.773450 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.773618 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.773776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.773948 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.774102 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.774274 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.774428 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.774721 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.774824 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.774982 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.775073 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.775287 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.775389 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.775674 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.775764 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.775980 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.776066 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.776288 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.776424 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.776593 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.776682 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.776988 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.777109 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.777332 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.777646 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.777763 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.777948 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.778240 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.778326 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.778540 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.778850 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.778932 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.779182 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.779451 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.779548 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.779796 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.780098 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.780239 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.780400 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.780611 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.780700 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.780950 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.781091 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.781305 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.781401 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.781637 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.781916 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.782055 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.782258 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.782345 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.782583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.782679 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.783021 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.783124 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.783243 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.783323 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.783556 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.783633 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.784127 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.784700 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.784988 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.785272 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.785371 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.785613 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.785717 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.785927 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.786043 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.786329 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.786431 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.786640 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.786812 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.786911 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.787033 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.787170 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.787355 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.787481 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.787691 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.787788 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.788018 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.788350 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.788530 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.788696 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.788846 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789014 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789159 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789321 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789450 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789639 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789772 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.789949 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.790088 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.790258 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.790402 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.790567 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.790732 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.790900 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.791088 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.791206 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.791404 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.791506 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.791739 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.791828 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.792079 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.792210 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.792419 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.792517 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.792736 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.792825 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793054 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793140 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793365 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793453 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793676 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793763 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.793986 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.794074 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.794375 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.794481 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.794649 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.794755 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.794984 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.795089 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.795294 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.795383 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.795604 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.795689 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.795912 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796005 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796220 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796312 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796525 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796649 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796831 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.796927 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.797137 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.797222 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.797444 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.797532 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.797750 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.797839 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.798060 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.798149 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.798398 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.798507 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.798688 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.799040 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.799354 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.799671 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.799979 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.800171 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.800289 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.800494 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.800817 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.800991 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.801133 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.801302 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.801491 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.801630 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.801808 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.801950 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.802153 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.802319 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.802489 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.802587 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.802850 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.802941 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.803197 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.803304 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.803499 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.803585 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.803799 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.803894 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.804650 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.804758 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.804963 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805059 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805265 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805401 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805586 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805682 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805893 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.805981 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.806194 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.806281 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.806514 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.806614 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.806841 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.806931 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.807210 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.807376 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.807533 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.807724 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.807857 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.808037 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.808360 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.808681 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.808870 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.808992 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.809211 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.809307 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.809542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.809677 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.809867 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.809996 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.810183 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.810260 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.810493 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.810585 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.810824 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.810906 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.811128 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.811204 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.811432 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.811527 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.811736 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.811813 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812109 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812223 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812341 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812439 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812645 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812740 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.812945 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813033 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813265 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813353 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813565 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813652 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813865 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.813976 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.814163 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.814300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.814469 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.814621 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.814789 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.815015 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.815122 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.815336 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.815466 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.815648 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.815736 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.816012 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.816129 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.816273 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.816454 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.816607 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817195 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817363 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817456 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817539 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817700 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817792 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.817996 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.818098 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.818302 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.818390 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.818657 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.818832 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.818999 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.819089 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.819300 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.819387 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.819599 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.820406 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.820506 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.820590 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.820814 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.820904 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.821131 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.821220 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.821439 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.821528 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.821747 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.821835 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.822091 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.822319 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.822416 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.822641 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.822968 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.823070 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.823302 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.823404 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.823705 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.823808 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.823954 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824041 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824279 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824377 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824580 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824667 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824898 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.824986 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.825205 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.825343 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.825521 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.825643 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.825826 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.825914 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.826137 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.826245 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.826439 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.826526 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.826770 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.826861 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827078 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827166 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827384 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827524 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827686 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827775 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.827992 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.828236 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.828326 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.828581 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.828670 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.828886 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.828988 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.829192 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.829281 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.829502 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.829589 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.829834 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.829921 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.830143 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.830232 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.830463 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.830601 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.830792 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.830883 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.831102 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.831187 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.831407 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.831494 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.831711 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.831800 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832014 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832102 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832315 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832401 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832623 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832711 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.832936 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833031 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833242 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833418 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833541 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833633 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833856 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.833950 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.834186 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.834283 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.834498 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.834593 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.834830 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.834921 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.835140 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.835245 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.835486 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.835576 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.835797 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.835887 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.836100 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.836188 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.836405 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.836491 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.836707 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.836794 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.837024 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.837191 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.837342 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.837678 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.837784 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.837893 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838115 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838217 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838353 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838501 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838663 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838879 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.838998 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.839130 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.839349 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.839447 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.839681 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.839782 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.839993 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840089 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840301 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840389 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840603 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840699 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.840994 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.841207 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.841295 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.841507 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.841608 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.841804 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.841899 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.842101 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.842188 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.842403 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.842491 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.842700 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.843040 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.843141 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.843313 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.843416 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.843659 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.843761 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844052 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844169 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844260 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844351 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844493 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844639 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844791 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.844948 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.845089 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.845256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.845386 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.845584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.845672 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.845903 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.846012 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.846215 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.846304 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.846532 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.846632 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.846867 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847066 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847170 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847253 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847480 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847590 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847800 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.847975 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.848105 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.848281 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.848417 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.848595 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.848729 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.848911 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.849042 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.849221 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.849354 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.849529 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.849688 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.849852 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.850016 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.850157 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.850340 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.850465 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.850664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.850840 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851036 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851130 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851360 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851454 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851674 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851765 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.851987 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.852074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.852301 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.852396 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.852608 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.852701 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.852923 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853066 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853234 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853335 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853560 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853655 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853870 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.853963 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.854173 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.854300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.854497 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.854618 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.854840 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.854967 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.855147 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.855291 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.855458 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.855611 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.855762 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.855931 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.856065 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.856256 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.856391 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.856569 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.856657 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.856906 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.857002 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.857222 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.857309 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.857554 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.857650 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.857883 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858003 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858198 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858295 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858523 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858609 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858856 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.858966 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.859166 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.859252 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.859474 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.859560 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.859788 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.859890 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.860091 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.860180 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.860392 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.860479 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.860630 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109136) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:46:21.860727 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.860989 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.861302 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.861611 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.861918 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.862224 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.862530 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.862868 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.863173 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.863484 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.863788 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.864093 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.864399 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.864707 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.865017 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.865323 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.865632 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.865939 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.866247 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.867118 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.867442 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.867793 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.868103 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.868470 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.868734 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.869054 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.869371 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.871542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.871542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.871542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.871542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.871542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.871542 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.872031 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.872031 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.872195 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.872496 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.872811 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.873146 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.873479 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.873789 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.874121 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.874441 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.874812 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.875122 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.875436 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.875766 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.876083 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.876398 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.876719 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.877030 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.877345 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.877665 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.877987 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.878319 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.878646 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.878983 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.879438 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.879880 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.880098 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.880423 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.880778 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.881128 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.881446 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.881754 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.882066 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:46:21.882883 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:46:21.885715 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_db.sqlalchemy.engines [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:21.907517 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_db.sqlalchemy.engines [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:21.952822 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.context [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc8b7433-1fad-4f12-b158-7b2f495bcb59(cell1) {{(pid=109136) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:46:21.957324 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_concurrency.lockutils [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:46:21.958950 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_concurrency.lockutils [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:46:21.959760 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_concurrency.lockutils [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:46:21.961980 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_concurrency.lockutils [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109136) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:46:21.976415 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_db.sqlalchemy.engines [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:21.978844 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_db.sqlalchemy.engines [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:22.003538 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.context [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc8b7433-1fad-4f12-b158-7b2f495bcb59(cell1) {{(pid=109135) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:46:22.011186 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:46:22.012886 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:46:22.013706 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:46:22.015708 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:46:22.029135 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_db.sqlalchemy.engines [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:22.033292 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_db.sqlalchemy.engines [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:22.146692 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG oslo_db.sqlalchemy.engines [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109136) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:22.203664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_db.sqlalchemy.engines [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:46:22.539305 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: WARNING keystonemiddleware.auth_token [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:46:22.547570 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: WARNING keystonemiddleware.auth_token [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:46:22.550051 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: WARNING keystonemiddleware.auth_token [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:46:22.557681 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: WARNING keystonemiddleware.auth_token [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:46:22.907831 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: WARNING keystonemiddleware.auth_token [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:46:22.914094 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: WARNING keystonemiddleware.auth_token [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:46:22.920458 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556b93ca09c0 pid: 109135 (default app) May 13 13:46:22.922653 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:46:22.923991 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] 10.222.0.79 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001979 May 13 13:46:22.924789 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 1/1] 10.222.0.79 () {50 vars in 788 bytes} [Fri May 13 13:46:22 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:46:22.928546 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: WARNING keystonemiddleware.auth_token [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:46:22.935008 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: WARNING keystonemiddleware.auth_token [None req-bceb5340-3bcf-40ea-9c30-76844b802b0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:46:22.942237 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556b93ca09c0 pid: 109136 (default app) May 13 13:47:47.062388 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:47.063492 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 May 13 13:47:47.063885 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 2/2] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:47.510619 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-f54bb656-07d3-4ed9-89f2-9a6238bc4e3c admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:47.541542 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-f54bb656-07d3-4ed9-89f2-9a6238bc4e3c admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469467 May 13 13:47:47.552063 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 1/3] 10.222.0.79 () {60 vars in 1291 bytes} [Fri May 13 13:47:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:47:49.899663 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:49.900728 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-c604e7ce-301d-4b17-8b2f-d4cfbd1d51b6 None None] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 13 13:47:49.903084 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 3/4] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:49.975232 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-f54e49d0-28c4-46a9-95f4-a8f54c386273 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 256, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "rxtx_factor": 1.0}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:49.994955 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:49.994955 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: warnings.warn(msg) May 13 13:47:50.027144 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-f54e49d0-28c4-46a9-95f4-a8f54c386273 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.120097 May 13 13:47:50.027804 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 2/5] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:47:49 2022] POST /compute/v2.1/flavors => generated 407 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:47:50.265959 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-35c29a71-b432-4206-8ceb-68e89a6a0c99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:50.268452 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:50.268452 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: warnings.warn(msg) May 13 13:47:50.322190 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-35c29a71-b432-4206-8ceb-68e89a6a0c99 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285707 May 13 13:47:50.330846 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 4/6] 10.222.0.79 () {64 vars in 1335 bytes} [Fri May 13 13:47:50 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:47:52.823864 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-f54e49d0-28c4-46a9-95f4-a8f54c386273 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:52.824891 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-f54e49d0-28c4-46a9-95f4-a8f54c386273 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 13 13:47:52.825335 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 3/7] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:47:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:52.947984 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-925e5d72-fd47-4952-b3e8-b015f43a3f43 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "id": "d1", "name": "ds512M", "rxtx_factor": 1.0}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:52.969173 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:52.969173 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: warnings.warn(msg) May 13 13:47:52.992681 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-925e5d72-fd47-4952-b3e8-b015f43a3f43 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.160137 May 13 13:47:52.993351 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 5/8] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:47:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:47:53.006730 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-f8077cd8-e587-4d31-8d4f-fba9c2d00c53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:53.008346 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:47:53.008346 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: warnings.warn(msg) May 13 13:47:53.056062 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-f8077cd8-e587-4d31-8d4f-fba9c2d00c53 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052791 May 13 13:47:53.057063 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 4/9] 10.222.0.79 () {64 vars in 1335 bytes} [Fri May 13 13:47:53 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:47:55.697423 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-925e5d72-fd47-4952-b3e8-b015f43a3f43 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:55.700080 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-925e5d72-fd47-4952-b3e8-b015f43a3f43 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003047 May 13 13:47:55.700634 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 6/10] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:55.785797 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-fef9e415-745c-46b4-bc02-7c7c224a94b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "disk": 10, "name": "ds1G", "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:55.810227 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-fef9e415-745c-46b4-bc02-7c7c224a94b1 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.099383 May 13 13:47:55.811704 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 5/11] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:47:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:47:55.832916 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-24c38c17-9f97-4a6f-9139-5ae2ea899298 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:55.862487 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-24c38c17-9f97-4a6f-9139-5ae2ea899298 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036121 May 13 13:47:55.863699 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 7/12] 10.222.0.79 () {64 vars in 1335 bytes} [Fri May 13 13:47:55 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:47:58.427742 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-fef9e415-745c-46b4-bc02-7c7c224a94b1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:47:58.428744 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-fef9e415-745c-46b4-bc02-7c7c224a94b1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 13 13:47:58.430100 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 6/13] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:47:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:47:58.492412 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-f786ff01-6f8d-44ac-b877-e6a547624ca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "swap": 0, "os-flavor-access:is_public": true, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:58.516890 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-f786ff01-6f8d-44ac-b877-e6a547624ca7 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080722 May 13 13:47:58.517503 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 8/14] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:47:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:47:58.534328 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-6e2eaf63-0ad1-4174-940b-ac7b71c493a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:47:58.562414 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-6e2eaf63-0ad1-4174-940b-ac7b71c493a2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034314 May 13 13:47:58.563117 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 7/15] 10.222.0.79 () {64 vars in 1335 bytes} [Fri May 13 13:47:58 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:48:00.983452 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-f786ff01-6f8d-44ac-b877-e6a547624ca7 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:00.984952 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-f786ff01-6f8d-44ac-b877-e6a547624ca7 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001976 May 13 13:48:00.985763 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 9/16] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:01.062941 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-3d477c93-9162-4225-8a97-bd3279eb1bd3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d4", "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:01.084929 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-3d477c93-9162-4225-8a97-bd3279eb1bd3 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091779 May 13 13:48:01.085695 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 8/17] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:48:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:01.102148 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-e3ca09cf-b3e8-4012-bd86-02f0f3593775 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:01.134490 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-e3ca09cf-b3e8-4012-bd86-02f0f3593775 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036554 May 13 13:48:01.135601 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 10/18] 10.222.0.79 () {64 vars in 1335 bytes} [Fri May 13 13:48:01 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:48:03.577478 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-3d477c93-9162-4225-8a97-bd3279eb1bd3 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:03.578481 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-3d477c93-9162-4225-8a97-bd3279eb1bd3 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 13 13:48:03.578910 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 9/19] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:03.647567 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-efa3caf4-aa13-4ff7-ab3d-2f1a3e41a5fe admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:03.673857 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-efa3caf4-aa13-4ff7-ab3d-2f1a3e41a5fe admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084841 May 13 13:48:03.674694 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 11/20] 10.222.0.79 () {60 vars in 1291 bytes} [Fri May 13 13:48:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:06.365798 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-3d477c93-9162-4225-8a97-bd3279eb1bd3 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:06.367803 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-3d477c93-9162-4225-8a97-bd3279eb1bd3 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002650 May 13 13:48:06.368388 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 10/21] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:06.448782 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-5a035440-57ff-4c64-9c4f-e57b193daf14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "swap": 0, "id": "1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "ram": 512, "vcpus": 1}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:06.469931 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-5a035440-57ff-4c64-9c4f-e57b193daf14 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.094762 May 13 13:48:06.470440 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 12/22] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:48:06 2022] POST /compute/v2.1/flavors => generated 402 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:06.487625 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-0d439196-c588-4210-a051-28f8907959e2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:06.514939 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-0d439196-c588-4210-a051-28f8907959e2 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032450 May 13 13:48:06.515630 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 11/23] 10.222.0.79 () {64 vars in 1332 bytes} [Fri May 13 13:48:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:48:09.328910 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-5a035440-57ff-4c64-9c4f-e57b193daf14 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:09.330660 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-5a035440-57ff-4c64-9c4f-e57b193daf14 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002411 May 13 13:48:09.331431 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 13/24] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:09 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:09.415974 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-069cd471-bb0a-4911-baa9-69bc8c506457 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "id": "2"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:09.436648 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-069cd471-bb0a-4911-baa9-69bc8c506457 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.095524 May 13 13:48:09.437177 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 12/25] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:48:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:09.450428 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-5588803f-e4da-4077-b9b5-7d176b71ac3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:09.476321 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-5588803f-e4da-4077-b9b5-7d176b71ac3d admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030034 May 13 13:48:09.476934 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 14/26] 10.222.0.79 () {64 vars in 1332 bytes} [Fri May 13 13:48:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:48:12.228457 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-069cd471-bb0a-4911-baa9-69bc8c506457 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:12.229602 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-069cd471-bb0a-4911-baa9-69bc8c506457 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 May 13 13:48:12.229939 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 13/27] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:12.337145 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-4eb98bd7-4a3a-46c3-a6ba-9e08832f274d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "swap": 0, "id": "3", "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:12.362730 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-4eb98bd7-4a3a-46c3-a6ba-9e08832f274d admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.119943 May 13 13:48:12.363316 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 15/28] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:48:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:12.378177 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-15f1b746-d074-47dc-b3e5-144d369f136e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:12.407546 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-15f1b746-d074-47dc-b3e5-144d369f136e admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034961 May 13 13:48:12.408481 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 14/29] 10.222.0.79 () {64 vars in 1332 bytes} [Fri May 13 13:48:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:48:14.879713 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-4eb98bd7-4a3a-46c3-a6ba-9e08832f274d admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:14.880746 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-4eb98bd7-4a3a-46c3-a6ba-9e08832f274d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 May 13 13:48:14.881172 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 16/30] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:48:14.945824 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-05748cdc-2dff-4dd2-bcac-d6944ae2f176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "rxtx_factor": 1.0, "vcpus": 4, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "os-flavor-access:is_public": true, "swap": 0, "ram": 8192}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:14.967951 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-05748cdc-2dff-4dd2-bcac-d6944ae2f176 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.079536 May 13 13:48:14.968508 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 15/31] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:48:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:14.981815 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-5fed79ba-892c-4a06-8832-994b73f6dc06 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:15.007495 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-5fed79ba-892c-4a06-8832-994b73f6dc06 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030081 May 13 13:48:15.008394 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 17/32] 10.222.0.79 () {64 vars in 1332 bytes} [Fri May 13 13:48:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:48:17.378172 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-05748cdc-2dff-4dd2-bcac-d6944ae2f176 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:17.379225 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-05748cdc-2dff-4dd2-bcac-d6944ae2f176 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 May 13 13:48:17.379886 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 16/33] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:17.473422 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-16d944da-35c8-4264-b408-443b13e986d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "ram": 16384, "name": "m1.xlarge"}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:17.519031 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-16d944da-35c8-4264-b408-443b13e986d8 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.130658 May 13 13:48:17.528322 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 18/34] 10.222.0.79 () {64 vars in 1282 bytes} [Fri May 13 13:48:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:17.563758 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-12b77a3f-e868-4b1f-b7c7-a6cbc1377cf7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:17.598085 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-12b77a3f-e868-4b1f-b7c7-a6cbc1377cf7 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069560 May 13 13:48:17.598790 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 17/35] 10.222.0.79 () {64 vars in 1332 bytes} [Fri May 13 13:48:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:48:43.411845 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-16d944da-35c8-4264-b408-443b13e986d8 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:43.413025 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-16d944da-35c8-4264-b408-443b13e986d8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001581 May 13 13:48:43.413433 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 19/36] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:48:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:43.491519 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-96254ae4-0f0f-4a7d-8df5-eb967955fc61 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:43.503499 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-96254ae4-0f0f-4a7d-8df5-eb967955fc61 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.083075 May 13 13:48:43.504143 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 18/37] 10.222.0.79 () {60 vars in 1291 bytes} [Fri May 13 13:48:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:44.587093 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-16d944da-35c8-4264-b408-443b13e986d8 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:44.588441 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-16d944da-35c8-4264-b408-443b13e986d8 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 May 13 13:48:44.588706 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 20/38] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:44.787395 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-5c409c00-4311-44ca-844d-726324430512 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:44.793553 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.wsgi [None req-5c409c00-4311-44ca-844d-726324430512 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-5c409c00-4311-44ca-844d-726324430512 admin admin] Request method failure captured: May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Accept: application/json May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Accept-Encoding: gzip, deflate May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Connection: keep-alive May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Content-Length: 0 May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Host: 10.222.0.79 May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Openstack-Api-Version: compute 2.90 May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Openstack-System-Scope: None May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: User-Agent: python-novaclient May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Auth-Token: gAAAAABifmG8Kxz79ZkEw_1cd2pLtyh-uMYfPTLyhzEK8kiwkQivKOHJlWPnEv5j2gwV-G2ksnz2lShUbZIrEgoCOBcrFRLjOS_eALD-s8dCfSrLHxVFYsijtGUN9KoFuC_sX6mA-eM0NYRVBkGO8ri_AS6-bluljfEUhJzgjeESpRI8vKOjn_Q May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Domain-Id: None May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Domain-Name: None May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Identity-Status: Confirmed May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Is-Admin-Project: True May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Domain-Id: default May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Domain-Name: Default May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Name: admin May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Role: admin,reader,member May 13 13:48:44.796907 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Roles: admin,reader,member May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/584c523555e7486e977f27ddcc51047b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_584c523555e7486e977f27ddcc51047b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant: admin May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant-Name: admin May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User: admin May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Domain-Id: default May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Domain-Name: Default May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Id: a0034eb1f585466fae466bc41ea6f933 May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Name: admin May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: method: > May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: exception: Flavor 42 could not be found. May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: action_args: {'id': '42'} May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:48:44.798620 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:44.799862 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:44.801311 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-5c409c00-4311-44ca-844d-726324430512 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:48:44.802676 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-5c409c00-4311-44ca-844d-726324430512 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.062343 May 13 13:48:44.802676 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 19/39] 10.222.0.79 () {60 vars in 1190 bytes} [Fri May 13 13:48:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:48:44.808699 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-f0de7791-79f1-46ff-b917-502317484c53 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:44.829949 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-f0de7791-79f1-46ff-b917-502317484c53 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024796 May 13 13:48:44.830526 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 21/40] 10.222.0.79 () {60 vars in 1210 bytes} [Fri May 13 13:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:44.858145 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-a322c7bf-3d6f-4600-8826-d328b8e09d5d admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:44.880447 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-a322c7bf-3d6f-4600-8826-d328b8e09d5d admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025880 May 13 13:48:44.881001 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 20/41] 10.222.0.79 () {60 vars in 1210 bytes} [Fri May 13 13:48:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:44.890620 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-7a48d815-918e-4ee8-a53d-c8928772074b admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:44.896421 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.wsgi [None req-7a48d815-918e-4ee8-a53d-c8928772074b admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-7a48d815-918e-4ee8-a53d-c8928772074b admin admin] Request method failure captured: May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Accept: application/json May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Accept-Encoding: gzip, deflate May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Connection: keep-alive May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Content-Length: 0 May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Host: 10.222.0.79 May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Openstack-Api-Version: compute 2.90 May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Openstack-System-Scope: None May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: User-Agent: python-novaclient May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Auth-Token: gAAAAABifmG8Kxz79ZkEw_1cd2pLtyh-uMYfPTLyhzEK8kiwkQivKOHJlWPnEv5j2gwV-G2ksnz2lShUbZIrEgoCOBcrFRLjOS_eALD-s8dCfSrLHxVFYsijtGUN9KoFuC_sX6mA-eM0NYRVBkGO8ri_AS6-bluljfEUhJzgjeESpRI8vKOjn_Q May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Domain-Id: None May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Domain-Name: None May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Identity-Status: Confirmed May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Is-Admin-Project: True May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Domain-Id: default May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Domain-Name: Default May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Name: admin May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Role: admin,reader,member May 13 13:48:44.899776 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Roles: admin,reader,member May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/584c523555e7486e977f27ddcc51047b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_584c523555e7486e977f27ddcc51047b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant: admin May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant-Name: admin May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User: admin May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Domain-Id: default May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Domain-Name: Default May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Id: a0034eb1f585466fae466bc41ea6f933 May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Name: admin May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: method: > May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: exception: Flavor 42 could not be found. May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: action_args: {'id': '42'} May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:48:44.902584 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:44.904664 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:44.906896 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-7a48d815-918e-4ee8-a53d-c8928772074b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:48:44.914483 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-7a48d815-918e-4ee8-a53d-c8928772074b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014278 May 13 13:48:44.914483 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 22/42] 10.222.0.79 () {60 vars in 1190 bytes} [Fri May 13 13:48:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:48:45.815058 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-a322c7bf-3d6f-4600-8826-d328b8e09d5d admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:45.816064 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-a322c7bf-3d6f-4600-8826-d328b8e09d5d admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 13 13:48:45.816455 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 21/43] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:46.008700 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-01c089ba-ad40-440b-b513-141135842ca7 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:46.013952 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.wsgi [None req-01c089ba-ad40-440b-b513-141135842ca7 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-01c089ba-ad40-440b-b513-141135842ca7 admin admin] Request method failure captured: May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Accept: application/json May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Accept-Encoding: gzip, deflate May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Connection: keep-alive May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Content-Length: 0 May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Host: 10.222.0.79 May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Openstack-Api-Version: compute 2.90 May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Openstack-System-Scope: None May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: User-Agent: python-novaclient May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Auth-Token: gAAAAABifmG9wi_HBVFmvvPrTv-HVNgHLZjy2_kPzEzjkuvBWkzeSCkRiZmge0PBMJIVckmk4Pr_vvcA0iWKal1nYdKTHZIYcWgdUKC9rjBRm37ZW9MFM-47wVVbs3sa5BFxV4uQAUhENEBGg85AMABzJBUZY63Sr1TbMRARPCG64_wk8X7TTj0 May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Domain-Id: None May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Domain-Name: None May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Identity-Status: Confirmed May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Is-Admin-Project: True May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Domain-Id: default May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Domain-Name: Default May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Name: admin May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Role: admin,reader,member May 13 13:48:46.015504 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Roles: admin,reader,member May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/584c523555e7486e977f27ddcc51047b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_584c523555e7486e977f27ddcc51047b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant: admin May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant-Name: admin May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User: admin May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Domain-Id: default May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Domain-Name: Default May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Id: a0034eb1f585466fae466bc41ea6f933 May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Name: admin May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: method: > May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: exception: Flavor 84 could not be found. May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: action_args: {'id': '84'} May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:48:46.017300 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:46.018540 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:46.019990 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-01c089ba-ad40-440b-b513-141135842ca7 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:48:46.021226 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-01c089ba-ad40-440b-b513-141135842ca7 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060267 May 13 13:48:46.021226 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 23/44] 10.222.0.79 () {60 vars in 1190 bytes} [Fri May 13 13:48:45 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:48:46.027079 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-64c6b60c-4fd6-4c16-bade-eb9f422ce9f6 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:46.041127 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-64c6b60c-4fd6-4c16-bade-eb9f422ce9f6 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017641 May 13 13:48:46.041672 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 22/45] 10.222.0.79 () {60 vars in 1210 bytes} [Fri May 13 13:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:46.051120 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-9f95d3e7-c9c1-4aac-a956-cd8f3ebfccad admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:46.064652 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-9f95d3e7-c9c1-4aac-a956-cd8f3ebfccad admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017059 May 13 13:48:46.065186 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 24/46] 10.222.0.79 () {60 vars in 1210 bytes} [Fri May 13 13:48:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:46.074807 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-051ca010-cdb8-4b44-bde5-90946a2b5fdd admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:46.080100 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.wsgi [None req-051ca010-cdb8-4b44-bde5-90946a2b5fdd admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-051ca010-cdb8-4b44-bde5-90946a2b5fdd admin admin] Request method failure captured: May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Accept: application/json May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Accept-Encoding: gzip, deflate May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Connection: keep-alive May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Content-Length: 0 May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Host: 10.222.0.79 May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Openstack-Api-Version: compute 2.90 May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Openstack-System-Scope: None May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: User-Agent: python-novaclient May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Auth-Token: gAAAAABifmG9wi_HBVFmvvPrTv-HVNgHLZjy2_kPzEzjkuvBWkzeSCkRiZmge0PBMJIVckmk4Pr_vvcA0iWKal1nYdKTHZIYcWgdUKC9rjBRm37ZW9MFM-47wVVbs3sa5BFxV4uQAUhENEBGg85AMABzJBUZY63Sr1TbMRARPCG64_wk8X7TTj0 May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Domain-Id: None May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Domain-Name: None May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Identity-Status: Confirmed May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Is-Admin-Project: True May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Domain-Id: default May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Domain-Name: Default May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Name: admin May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Role: admin,reader,member May 13 13:48:46.081583 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Roles: admin,reader,member May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/584c523555e7486e977f27ddcc51047b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_584c523555e7486e977f27ddcc51047b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant: admin May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant-Name: admin May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User: admin May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Domain-Id: default May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Domain-Name: Default May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Id: a0034eb1f585466fae466bc41ea6f933 May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Name: admin May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: method: > May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: exception: Flavor 84 could not be found. May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: action_args: {'id': '84'} May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:48:46.083126 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:46.084074 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:46.085873 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-051ca010-cdb8-4b44-bde5-90946a2b5fdd admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:48:46.087207 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-051ca010-cdb8-4b44-bde5-90946a2b5fdd admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011677 May 13 13:48:46.087207 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 23/47] 10.222.0.79 () {60 vars in 1190 bytes} [Fri May 13 13:48:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 13 13:48:46.980193 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-9f95d3e7-c9c1-4aac-a956-cd8f3ebfccad admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:46.981226 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-9f95d3e7-c9c1-4aac-a956-cd8f3ebfccad admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 May 13 13:48:46.981623 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 25/48] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:47.170504 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-46200844-3167-4f8b-a4d1-90d8f0f3f057 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:47.176793 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.wsgi [None req-46200844-3167-4f8b-a4d1-90d8f0f3f057 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-46200844-3167-4f8b-a4d1-90d8f0f3f057 admin admin] Request method failure captured: May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Accept: application/json May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Accept-Encoding: gzip, deflate May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Connection: keep-alive May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Content-Length: 0 May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Host: 10.222.0.79 May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Openstack-Api-Version: compute 2.90 May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Openstack-System-Scope: None May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: User-Agent: python-novaclient May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Auth-Token: gAAAAABifmG-tFwadgoIwi7R1OXJrPsVzFShf5jmV_rb-Y_6-EvOPSxpIRKdjz3Z5Hu1NBWOAhfCvDAA8SHZ-QqEBhGZYC6hURGgKlFDeAn-IVAwcPnDbu34k_766h3b4l3iVGfwVM5phA2kkRUthbwiBg9d_ZNmYtAj1shOm1hQC7cEoazTjuU May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Domain-Id: None May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Domain-Name: None May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Identity-Status: Confirmed May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Is-Admin-Project: True May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Domain-Id: default May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Domain-Name: Default May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Project-Name: admin May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Role: admin,reader,member May 13 13:48:47.178931 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Roles: admin,reader,member May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/584c523555e7486e977f27ddcc51047b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_584c523555e7486e977f27ddcc51047b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant: admin May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-Tenant-Name: admin May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User: admin May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Domain-Id: default May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Domain-Name: Default May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Id: a0034eb1f585466fae466bc41ea6f933 May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: X-User-Name: admin May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: method: > May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: exception: Flavor 451 could not be found. May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: action_args: {'id': '451'} May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:48:47.180559 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:47.181379 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: ERROR nova.api.openstack.wsgi May 13 13:48:47.182486 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-46200844-3167-4f8b-a4d1-90d8f0f3f057 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109136) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:48:47.183546 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-46200844-3167-4f8b-a4d1-90d8f0f3f057 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062254 May 13 13:48:47.183546 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 24/49] 10.222.0.79 () {60 vars in 1193 bytes} [Fri May 13 13:48:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:48:47.191053 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-a174a238-4973-41b8-8b8a-55fd1da7b7db admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:47.205495 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-a174a238-4973-41b8-8b8a-55fd1da7b7db admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018509 May 13 13:48:47.206049 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1210 bytes} [Fri May 13 13:48:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:48:47.216352 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:47.230300 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017461 May 13 13:48:47.230889 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 25/51] 10.222.0.79 () {60 vars in 1210 bytes} [Fri May 13 13:48:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:48:47.240238 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-35915a3a-9eac-4716-ad8a-c1acb0bba766 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:47.246292 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.wsgi [None req-35915a3a-9eac-4716-ad8a-c1acb0bba766 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-35915a3a-9eac-4716-ad8a-c1acb0bba766 admin admin] Request method failure captured: May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Accept: application/json May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Accept-Encoding: gzip, deflate May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Connection: keep-alive May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Content-Length: 0 May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Host: 10.222.0.79 May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Openstack-Api-Version: compute 2.90 May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Openstack-System-Scope: None May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: User-Agent: python-novaclient May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Auth-Token: gAAAAABifmG-tFwadgoIwi7R1OXJrPsVzFShf5jmV_rb-Y_6-EvOPSxpIRKdjz3Z5Hu1NBWOAhfCvDAA8SHZ-QqEBhGZYC6hURGgKlFDeAn-IVAwcPnDbu34k_766h3b4l3iVGfwVM5phA2kkRUthbwiBg9d_ZNmYtAj1shOm1hQC7cEoazTjuU May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Domain-Id: None May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Domain-Name: None May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Identity-Status: Confirmed May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Is-Admin-Project: True May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Openstack-Nova-Api-Version: 2.90 May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Domain-Id: default May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Domain-Name: Default May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Project-Name: admin May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Role: admin,reader,member May 13 13:48:47.247847 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Roles: admin,reader,member May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/584c523555e7486e977f27ddcc51047b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/584c523555e7486e977f27ddcc51047b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_584c523555e7486e977f27ddcc51047b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant: admin May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant-Id: 584c523555e7486e977f27ddcc51047b May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-Tenant-Name: admin May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User: admin May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Domain-Id: default May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Domain-Name: Default May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Id: a0034eb1f585466fae466bc41ea6f933 May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: X-User-Name: admin May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: method: > May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: exception: Flavor 451 could not be found. May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: action_args: {'id': '451'} May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:48:47.249735 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:47.250654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: ERROR nova.api.openstack.wsgi May 13 13:48:47.252255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-35915a3a-9eac-4716-ad8a-c1acb0bba766 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:48:47.253657 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-35915a3a-9eac-4716-ad8a-c1acb0bba766 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012544 May 13 13:48:47.253657 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 27/52] 10.222.0.79 () {60 vars in 1193 bytes} [Fri May 13 13:48:47 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 13:48:48.180134 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:48.181153 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 May 13 13:48:48.181551 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 26/53] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:48.388968 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-b979103a-cad9-46ad-93a9-3130bb931e56 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:48.407409 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-b979103a-cad9-46ad-93a9-3130bb931e56 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.074710 May 13 13:48:48.408016 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 28/54] 10.222.0.79 () {64 vars in 1235 bytes} [Fri May 13 13:48:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:49.332488 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:49.333743 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001832 May 13 13:48:49.334164 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 27/55] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:49.559984 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-5f7e0a18-511b-440f-8c2a-23262f7af3d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:49.578855 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-5f7e0a18-511b-440f-8c2a-23262f7af3d9 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.077821 May 13 13:48:49.579408 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 29/56] 10.222.0.79 () {64 vars in 1235 bytes} [Fri May 13 13:48:49 2022] POST /compute/v2.1/flavors => generated 405 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:50.500996 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:50.502015 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 May 13 13:48:50.502412 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 28/57] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:50.695716 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-4910136c-b463-4b0f-ab0d-1e49a19da370 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:50.712335 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-4910136c-b463-4b0f-ab0d-1e49a19da370 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.070186 May 13 13:48:50.712877 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 30/58] 10.222.0.79 () {64 vars in 1235 bytes} [Fri May 13 13:48:50 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:51.617317 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:51.618332 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001399 May 13 13:48:51.618752 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 29/59] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:51.822808 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-4fd41b4b-5c66-4c4e-9357-5d95c7befde4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:48:51.845220 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-4fd41b4b-5c66-4c4e-9357-5d95c7befde4 admin admin] 10.222.0.79 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.086825 May 13 13:48:51.846141 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 31/60] 10.222.0.79 () {64 vars in 1235 bytes} [Fri May 13 13:48:51 2022] POST /compute/v2.1/flavors => generated 409 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:48:52.791135 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:52.792040 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 May 13 13:48:52.792445 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 30/61] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:48:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:48:52.983954 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-3d93f86a-defa-4a4e-9a67-efdf308b8360 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:48:53.004516 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-3d93f86a-defa-4a4e-9a67-efdf308b8360 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075361 May 13 13:48:53.004996 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 32/62] 10.222.0.79 () {60 vars in 1202 bytes} [Fri May 13 13:48:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:49:57.775285 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.776285 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-796f0f66-b42e-4c6e-a863-b193425e8ff1 admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 13 13:49:57.776682 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 31/63] 10.222.0.79 () {54 vars in 930 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:49:57.839588 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-b8e91644-979a-41aa-bfe8-19cded8422fb admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.859428 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-b8e91644-979a-41aa-bfe8-19cded8422fb admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.076790 May 13 13:49:57.859983 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 33/64] 10.222.0.79 () {60 vars in 1291 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:49:57.882570 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-21a652ad-9184-47af-8aff-ac747f975ae3 admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.890437 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-21a652ad-9184-47af-8aff-ac747f975ae3 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012263 May 13 13:49:57.891015 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 32/65] 10.222.0.79 () {60 vars in 1282 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:57.903239 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-0d909930-ad7a-4557-be98-88269fe7cd7a admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.911857 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-0d909930-ad7a-4557-be98-88269fe7cd7a admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011638 May 13 13:49:57.914534 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 34/66] 10.222.0.79 () {60 vars in 1285 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:49:57.925337 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.933726 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011900 May 13 13:49:57.934285 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 33/67] 10.222.0.79 () {60 vars in 1285 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:49:57.946661 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-a91774ed-e019-499b-8cc5-55b094b20c06 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:49:57.954611 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-a91774ed-e019-499b-8cc5-55b094b20c06 admin admin] 10.222.0.79 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011912 May 13 13:49:57.955153 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 35/68] 10.222.0.79 () {60 vars in 1282 bytes} [Fri May 13 13:49:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:53:36.584448 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:36.585531 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 May 13 13:53:36.585889 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 34/69] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:53:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:36.905726 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-8d490f2a-3f82-45d2-820c-61550329ce8c admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:36.906952 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:53:36.906952 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: warnings.warn(msg) May 13 13:53:36.908141 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-8d490f2a-3f82-45d2-820c-61550329ce8c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:36.908586 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-8d490f2a-3f82-45d2-820c-61550329ce8c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:36.909489 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-8d490f2a-3f82-45d2-820c-61550329ce8c admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:36.909984 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-8d490f2a-3f82-45d2-820c-61550329ce8c admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:36.945882 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-8d490f2a-3f82-45d2-820c-61550329ce8c admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.196749 May 13 13:53:36.946471 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 36/70] 10.222.0.79 () {60 vars in 1193 bytes} [Fri May 13 13:53:36 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:53:37.982159 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:37.983440 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001915 May 13 13:53:37.984124 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 35/71] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:38.186513 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-2cb80c0f-56ee-4108-a678-c21ffd9455f2 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:38.188634 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:53:38.188634 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: warnings.warn(msg) May 13 13:53:38.190654 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-2cb80c0f-56ee-4108-a678-c21ffd9455f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:38.191523 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-2cb80c0f-56ee-4108-a678-c21ffd9455f2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:38.192985 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-2cb80c0f-56ee-4108-a678-c21ffd9455f2 admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:38.193784 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-2cb80c0f-56ee-4108-a678-c21ffd9455f2 admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:38.229512 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-2cb80c0f-56ee-4108-a678-c21ffd9455f2 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.098611 May 13 13:53:38.230544 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 37/72] 10.222.0.79 () {60 vars in 1193 bytes} [Fri May 13 13:53:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:53:49.665646 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:49.666655 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 13 13:53:49.667102 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 36/73] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:53:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:53:49.880012 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-286364d8-88c3-4731-b353-cdb09e38fd5d admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:49.881255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:53:49.881255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: warnings.warn(msg) May 13 13:53:49.882643 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-286364d8-88c3-4731-b353-cdb09e38fd5d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:49.883255 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-286364d8-88c3-4731-b353-cdb09e38fd5d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:49.884097 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-286364d8-88c3-4731-b353-cdb09e38fd5d admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:49.884560 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-286364d8-88c3-4731-b353-cdb09e38fd5d admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:49.912293 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-286364d8-88c3-4731-b353-cdb09e38fd5d admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.087721 May 13 13:53:49.912959 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 38/74] 10.222.0.79 () {60 vars in 1193 bytes} [Fri May 13 13:53:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:53:50.908910 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: DEBUG nova.api.openstack.wsgi [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] Calling method '>' {{(pid=109136) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:50.910047 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: INFO nova.api.openstack.requestlog [None req-e8c3e074-e0fa-4ef1-854e-58c037f6965b admin admin] 10.222.0.79 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001753 May 13 13:53:50.910591 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: [pid: 109136|app: 0|req: 37/75] 10.222.0.79 () {56 vars in 1074 bytes} [Fri May 13 13:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:53:51.120050 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG nova.api.openstack.wsgi [None req-b436f179-8b4b-4bb8-b793-f1afc6cf2687 admin admin] Calling method '>' {{(pid=109135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:53:51.121356 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 13:53:51.121356 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: warnings.warn(msg) May 13 13:53:51.122685 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-b436f179-8b4b-4bb8-b793-f1afc6cf2687 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:51.123156 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-b436f179-8b4b-4bb8-b793-f1afc6cf2687 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:51.123979 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-b436f179-8b4b-4bb8-b793-f1afc6cf2687 admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:53:51.124405 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: DEBUG oslo_concurrency.lockutils [None req-b436f179-8b4b-4bb8-b793-f1afc6cf2687 admin admin] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:53:51.146912 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: INFO nova.api.openstack.requestlog [None req-b436f179-8b4b-4bb8-b793-f1afc6cf2687 admin admin] 10.222.0.79 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091964 May 13 13:53:51.147491 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: [pid: 109135|app: 0|req: 39/76] 10.222.0.79 () {60 vars in 1193 bytes} [Fri May 13 13:53:51 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:54:52.159392 dv-cinder-841753-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 13:54:52.160067 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: Fri May 13 13:54:52 2022 - graceful shutdown triggered... May 13 13:54:52.160525 dv-cinder-841753-1-iscsi devstack@n-api.service[109135]: Gracefully killing worker 1 (pid: 109135)... May 13 13:54:52.161344 dv-cinder-841753-1-iscsi devstack@n-api.service[109136]: Gracefully killing worker 2 (pid: 109136)... May 13 13:54:53.161089 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: worker 1 buried after 1 seconds May 13 13:54:53.161089 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: worker 2 buried after 1 seconds May 13 13:54:53.161089 dv-cinder-841753-1-iscsi devstack@n-api.service[109134]: goodbye to uWSGI. May 13 13:54:53.162686 dv-cinder-841753-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 13:54:53.163301 dv-cinder-841753-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 13:54:53.165973 dv-cinder-841753-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 13:54:53.182770 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 13:54:53 2022] *** May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: nodename: dv-cinder-841753-1-iscsi May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: machine: x86_64 May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: clock source: unix May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: pcre jit disabled May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: detected number of CPU cores: 4 May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: current working directory: / May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: detected binary path: /usr/bin/uwsgi-core May 13 13:54:53.202290 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: your processes number limit is 47680 May 13 13:54:53.203211 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: your memory page size is 4096 bytes May 13 13:54:53.203211 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: detected max file descriptor number: 2048 May 13 13:54:53.203211 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: lock engine: pthread robust mutexes May 13 13:54:53.203211 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: thunder lock: enabled May 13 13:54:53.203211 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 13:54:53.203211 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 13:54:53.250927 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: Python main interpreter initialized at 0x557544c829c0 May 13 13:54:53.250927 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: python threads support enabled May 13 13:54:53.250927 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: your server socket listen backlog is limited to 100 connections May 13 13:54:53.250927 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: your mercy for graceful operations on workers is 90 seconds May 13 13:54:53.251353 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: mapped 403077 bytes (393 KB) for 2 cores May 13 13:54:53.251353 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: *** Operational MODE: preforking *** May 13 13:54:53.251558 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: *** uWSGI is running in multiple interpreter mode *** May 13 13:54:53.251558 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: spawned uWSGI master process (pid: 123496) May 13 13:54:53.251772 dv-cinder-841753-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 13:54:53.252674 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: spawned uWSGI worker 1 (pid: 123511, cores: 1) May 13 13:54:53.252674 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: spawned uWSGI worker 2 (pid: 123512, cores: 1) May 13 13:54:53.252865 dv-cinder-841753-1-iscsi devstack@n-api.service[123496]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 13:54:54.483109 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:54:54.490074 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 13:54:55.283988 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:54:55.283988 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: from cryptography.utils import int_from_bytes May 13 13:54:55.284271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:54:55.284271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: from cryptography.utils import int_from_bytes May 13 13:54:55.305772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:54:55.305772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: from cryptography.utils import int_from_bytes May 13 13:54:55.306191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 13:54:55.306191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: from cryptography.utils import int_from_bytes May 13 13:54:57.769034 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:54:57.769608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:54:57.770396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:54:57.770779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:54:57.771048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:54:57.771434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.771762 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.772081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.772401 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.772730 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.773040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.773361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.773681 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.774007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.774268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.774583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.774937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-1-iscsi {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.775262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.775569 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.775880 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.776198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.776503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.776826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.777133 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.777628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.778067 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.778376 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.778689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.779110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.779361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.779670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.779990 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.780301 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.780626 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.780935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.781333 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-1-iscsi {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.781665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.781965 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.782279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.782697 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.783041 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.783349 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.783671 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.783994 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.784301 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.784630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.784951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.785300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.785615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.785920 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.786230 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.786539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.786886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.787195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.787501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.787759 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.788084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.788410 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.788732 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.789067 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.789338 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.789576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.790069 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.790571 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.791080 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.791570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.791873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.792185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.792496 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.792811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.793119 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.793428 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.793752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.794070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.794571 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.794908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.795232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.795863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.796114 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.796428 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.796773 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.797097 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.797413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.797735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.798060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.798371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.798681 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.799023 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.799346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.799682 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.799989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.800242 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.800546 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.800853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.801206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.801586 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.801847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.802117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.802417 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.802831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.803057 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.803365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.803671 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.803977 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.804284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.804589 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.804892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.805195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.805515 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.805835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.806141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.806446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.806772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.807081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.807399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.807705 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.808009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.808328 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.808634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.808937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.809254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.809567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.809871 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.810191 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.810491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.811093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.811411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.811718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.812023 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.812325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.812629 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.812933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.813236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.813540 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.813897 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.814139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.814459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.814803 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.815118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.815424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.815727 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.816046 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.816380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.817295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.817611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.817958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.818274 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.818608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.818961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.819256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.823054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.824239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.825348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.825348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.825348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.825775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.825775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.826062 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.826352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.826664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.827012 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.827346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.827660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.827977 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.828291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.828604 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.828916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.829228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.829539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.829877 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.830199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.830515 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.830851 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.831170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.831483 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.831795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.832105 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.832992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 13:54:57.833486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 13:54:57.833645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.833645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.833951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 13:54:57.834099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.834253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 13:54:57.834410 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.834557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 13:54:57.834813 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.835000 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.835149 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.835302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.835464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.835612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.835765 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.835923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.836072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.836227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.836382 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.836382 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.836678 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.836678 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.836991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.836991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.837292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.837439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.837584 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.837584 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.837869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.838030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.838177 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.838177 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.838475 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841753-1-iscsi {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.838630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.838824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.838991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.839139 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.839294 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.839448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.839595 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.839759 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.839914 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.840070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.840228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.840383 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.840530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.840685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.840851 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.840998 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.841172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.841320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.841475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.841630 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.841784 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.841941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.842095 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.842242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.842399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.842399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.842702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.842702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.843017 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.843017 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.843314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.843471 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.843625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.843779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.843927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.844238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.844385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.844542 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841753-1-iscsi {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.844696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.844851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.845021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.845169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.845315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.845462 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.845608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.845769 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.845917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.846071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.846225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.846383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.846528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.846695 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.846915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.847081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.847238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.847393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.847541 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.847697 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.847875 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.848032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.848179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.848325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.848496 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.848652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.848800 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.848945 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.849091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.849238 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.849393 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.849539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.849687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.849840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.849995 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.850151 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.850308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.850473 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.850621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.850799 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.850953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.851107 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.851268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.851416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.851562 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.851709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.851864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.852020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.852182 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.852358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.852523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.852672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.852820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.852969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.853130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.853293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.853441 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.853599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.853755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.853911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.854067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.854225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.854379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.854536 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.854691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.854886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.855050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.855204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.855360 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.855507 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.855661 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.855823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.855972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.856128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.856287 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.856440 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.856595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.856761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.856909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.857057 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.857211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.857359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.857514 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.857675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.857831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.79 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.857979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.858126 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.79 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.858290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.858445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.858672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.858847 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.859015 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.859172 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.859320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.859466 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.859626 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.859789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.859944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.860100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.860259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.860414 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.860563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.860717 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.860865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.861020 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.861167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.861167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.861465 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.861613 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.861767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.861922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.862069 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.862069 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.862380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.862380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.862667 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.862876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.863037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.863194 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.863342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.864021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.864182 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.864337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.864497 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.864658 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.864823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.864979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.865133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.865281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.865443 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.865591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.865745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.865914 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.866071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.866218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.866374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.866522 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.866669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.866858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.867008 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.867164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.867322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.867469 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.867624 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.867780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.867935 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.868091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.868250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.868406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.868555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.868709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.868874 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.869032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.869180 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.869326 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.869480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.869628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.869785 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.869940 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.870095 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.870256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.870417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.870572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.870846 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.871042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.871217 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.871375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.871533 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.871691 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.871846 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.872001 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.872148 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.872302 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.872468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.872615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.872763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.872928 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.873075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.873231 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.873379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.873524 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.873679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.873826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.873972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.874140 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.874295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.874442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.874588 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.874760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.874924 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.875084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.875238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.875384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.875529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.875682 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.875837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.875998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.876153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.876300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.876451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.876598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.876753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.876910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.877072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.877229 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.877229 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.877528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.877689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.877837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.877991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.878145 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.878292 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.878446 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.878602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.878780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 13:54:57.878944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.879150 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.879150 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.879943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880109 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880413 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880568 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880724 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.880888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.881184 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.881346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.881492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.881646 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.881808 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.881955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.882101 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.882255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.882410 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.882567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.882741 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.882896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883367 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.883981 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.884317 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.884476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.884632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.884780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.884934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.885090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.885251 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.885418 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.885566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.885713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.885868 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.886016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.886173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.886173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.886530 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.886743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.886908 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.887154 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.887314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.887486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.887659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.887814 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.887975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.888138 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.888301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.888455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.888616 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.888778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.888932 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.889098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.889259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.889422 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.889585 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.889761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.889915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.890082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.890237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.890397 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.890552 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.890724 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.890904 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.891059 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.891221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.891376 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.891536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.891701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.891867 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892022 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892184 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892639 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892802 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.892957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.893111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.893265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.893419 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.893587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.893753 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.893915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.894068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.894230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.894391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.894556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.894762 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.894936 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.895091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.895245 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.895405 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.895569 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.895723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.895888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.896042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.896203 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.896364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.896533 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.896688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.896848 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897176 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.897982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.898135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.898297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.898452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.898606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.898832 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899006 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899338 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899493 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899970 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.899970 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.900286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.900442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.900602 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.900756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.900917 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.901073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.901236 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.901390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.901550 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.901704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.901864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.902039 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.902195 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.902347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.902509 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.902671 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.902860 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903182 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903345 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903662 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.903987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.904152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.904315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.904468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.904621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.904781 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.904944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.905099 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.905255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.905416 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.905577 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.905746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.905899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.906060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.906223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.906385 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.906539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.906722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.906883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.907048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.907213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.907376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.907538 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.907538 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.907848 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.908010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.913928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.914161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.914341 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.914523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.914685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.914882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.915041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.915205 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.915376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.915532 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.915687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.915850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916013 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.916979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.917152 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.917318 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.917481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.917643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.917798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.917961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.918123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.918301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.918456 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.918609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.918793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.918954 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.919117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.919280 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.919442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.919596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.919749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.919912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.920076 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.920230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.920406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.920568 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.920721 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.920883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.921052 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.921207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.921360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.921522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.921725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.922826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923003 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923249 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923484 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923484 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923870 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.923949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924109 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924188 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924349 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924662 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924890 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.924961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925340 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925412 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925709 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925788 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.925880 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926894 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.926965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927108 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927333 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927413 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927727 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927807 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927879 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.927958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928410 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928573 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.928789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929769 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.929988 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930065 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930234 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930522 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930833 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930907 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.930985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931303 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931838 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.931988 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.932235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933328 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.933890 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.934545 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.934738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.934996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.935133 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.935264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.935264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.935516 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.935907 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.936053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.936191 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.936330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.936502 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.936672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.936857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.937029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.937165 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.937480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.937620 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.937824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.938000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.938147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.938437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.938585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.938773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.938994 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.939143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.939388 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.939519 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.939712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.939934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.940311 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.940458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.940657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.940836 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.940971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.941416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.941607 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.942270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.942400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.942552 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.942925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.943073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.943262 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.943483 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.943633 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.943916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.944070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.944235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.944430 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.944578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.944845 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.944976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.945164 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.945439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.945583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.945812 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.945949 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.946078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.946293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.946426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.946683 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.946834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.947025 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.947259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.947402 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.947633 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.947772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.947955 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.948200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.948344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.948571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.948709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.948873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.949136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.949275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.949503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.949643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.950623 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.950879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951015 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951841 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.951981 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952124 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952508 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.952899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.953154 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.953288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.953424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.953563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.953727 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.953861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.954157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.954287 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.954474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.954673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.954841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.955116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.955247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.955431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.955614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.955763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.956050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.956181 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.956362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.956578 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.956713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.956972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.957105 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.957330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.957555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.957689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.957941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.958087 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.958251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.958524 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.958669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.958936 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.959068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.959211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.959483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.959615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.959792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.960008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.960151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.960410 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.960549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.960722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.960943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.961087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.961330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.961462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.961643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.961882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.962023 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.962312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.962469 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.962599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.962852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.962987 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.963245 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.963400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.963651 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.963786 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.963923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.964097 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.964236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.964410 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.964667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.964808 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.965048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.965180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.965359 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.965570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.965711 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.965969 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.966101 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.966289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.966508 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.966650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967589 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967859 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.967996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.968133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.968409 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.968552 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.968747 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.968879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.969095 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.969256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.969398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.969653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.969794 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.969962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.970206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.970348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.970609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.970761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.971005 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.971279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.971955 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.971955 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.972229 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.972391 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.972599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.972733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.972733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.972997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.973120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.973241 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.973515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.973786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.974096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.974406 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.974751 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.975066 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.975384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.975700 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.976029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.976362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.976692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.977001 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.977313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.977628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.977939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.978797 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.978944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979428 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979568 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979568 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.979952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.980089 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.980217 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.980357 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.980640 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.980783 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.980971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.981158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.981297 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.981595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.981726 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.981910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.982117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.982249 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.982516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.982818 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.982961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.983091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.983220 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.983447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.983604 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.983904 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.984048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.984303 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.984503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.984778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.984923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.985116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.985299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.985432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.985734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.985873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.986060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.986252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.986393 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.986720 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.986857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.987110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.987244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.987430 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.987677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.989791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.989952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.990982 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991505 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.991910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.992161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.992292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.992292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.992603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.992750 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.992750 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.993116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.993250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.993392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.993522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.993659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.993804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.994109 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.994393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.994555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.994686 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.994835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.994977 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.995246 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.995390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.995614 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.995754 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.995884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.996185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.996324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.996504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.996684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.996818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.997126 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.997265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.997457 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.997611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.997789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.998072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.998230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.998427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.998573 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.998877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.999028 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.999213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.999459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.999592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:57.999905 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.000046 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.000185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.000394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.000527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.000773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.000915 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.001092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.001377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.001518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.001706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.001885 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.002039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.002334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.002475 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.002660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.002876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.003113 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.003310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.003449 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.003621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.003933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.004937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.005087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.005219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.005349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.005478 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.005614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.005744 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.006050 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.006185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.006376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.006563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.006722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.007044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.007210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.007378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.007555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.007688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.007952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.008123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.008255 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.008505 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.008646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.008908 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.009052 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.009224 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.009420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.009561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.009863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.010016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.010229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.010370 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.010508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.010913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.011077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.011212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.011350 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.011480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.011740 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.011882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.012093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.012226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.012404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.012671 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.012804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.013017 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.013330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.013464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.013642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.013949 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.014089 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.014254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.014451 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.014583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015435 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015822 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.015968 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.016137 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.016353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.016490 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.016753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.016893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.017062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.017278 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.017419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.017703 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.017835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.018043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.018351 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.018495 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.018634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.018823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.019026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.019172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.019343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.019551 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.019710 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.020013 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.020154 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.020371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.020503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.020643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.020936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.021174 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.021323 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.021459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.021597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.021850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.021991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.022161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.022359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.022501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.027580 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.027766 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.027912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.028192 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.028192 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.028538 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.028657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.028779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.028892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.029873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030012 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030150 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030280 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030535 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.030981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.031114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.031373 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.031516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.031655 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.031863 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.031995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.032132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.032271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.032643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.032794 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.032929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.033321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.033612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.033758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.033900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.033900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034165 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034436 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034630 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.034931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.036301 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.036448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.036448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.036842 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037287 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037830 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.037830 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038803 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.038964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.039210 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.039355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.039494 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.039624 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.039624 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.039910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040396 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040859 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.040988 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.041132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.041132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.041431 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.041664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.041830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.041971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.042128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.042259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.042419 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.042548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.042548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.042902 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.043043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.043043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.043581 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.043794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.043969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044799 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.044799 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.045930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.046174 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.046344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.046482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.046620 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.046620 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.046906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.047037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.047202 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.048902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049184 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049184 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.049961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.050104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.050242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.050242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.050521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.050657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.051469 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.051609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.051898 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052573 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052704 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052704 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.052969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.053108 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.053108 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.053655 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.053888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054022 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054697 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054855 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.054855 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.055116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.055240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.055553 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.055688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.055688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.055966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056251 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.056925 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057415 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057553 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057553 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.057970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.058245 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.058405 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.058653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.058867 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.059077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.059372 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.059519 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.059693 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.060027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.060165 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.060348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.060968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.061120 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.061265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.061694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.062017 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.062339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.062659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.063272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.063427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.063427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.063835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.063989 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064465 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064868 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.064963 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.065059 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.065269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.065363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.065598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.065732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.065915 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.066022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.066235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.066327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.066652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.067427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.067541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.067630 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.067846 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.067941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.068163 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.068289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.068481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.068596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.068796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.068900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.069121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.069232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.069434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.069537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.069747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.069907 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.070060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.070230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.070374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.070557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.070685 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.070984 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.071086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.071310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.071485 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.071632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.071792 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.071948 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.072129 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.072288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.072432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.072580 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.072737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.072961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.073109 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.073269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.073416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.073557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.073715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.073958 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.074130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.074304 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.074441 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.074582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.074758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.074897 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075055 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075204 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075805 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.075955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076097 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076525 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.076963 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.077141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.077284 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.077458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.077609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.077784 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.077886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.078093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.078238 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.078408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.078563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.078792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.078887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079656 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.079966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080691 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080897 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.080998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.081209 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.081320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.081514 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.081615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.081824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.081931 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.082149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.082252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.082558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.082664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.082891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.083104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.083246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.083346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.083534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.083766 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.083860 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.084197 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.084303 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.084600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.084763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.084926 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.085048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.085248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.085621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.085942 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123511) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:54:58.086104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.086404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.087005 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.087331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.087511 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.087722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.088041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.088362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.088686 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.089136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.089455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.089796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.090133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.090449 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.090839 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.092244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.092586 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.092979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.093313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.093660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.093988 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.094314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.094640 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.094994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.095319 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.095645 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.095977 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.096315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.096652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.096975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.097312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.097657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.098047 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.098373 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.098748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.099092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.099419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.099739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.100054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 13:54:58.100435 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=123512) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 13:54:58.111260 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_db.sqlalchemy.engines [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.125138 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_db.sqlalchemy.engines [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.177789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.context [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc8b7433-1fad-4f12-b158-7b2f495bcb59(cell1) {{(pid=123511) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:54:58.182225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:58.183881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:58.184725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:58.186998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:58.190634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.context [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),bc8b7433-1fad-4f12-b158-7b2f495bcb59(cell1) {{(pid=123512) load_cells /opt/stack/nova/nova/context.py:464}} May 13 13:54:58.195913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:58.197594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:58.198457 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:54:58.199332 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_db.sqlalchemy.engines [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.200613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:54:58.201116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_db.sqlalchemy.engines [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.212581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_db.sqlalchemy.engines [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.214922 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_db.sqlalchemy.engines [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.361735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_db.sqlalchemy.engines [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123511) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.377586 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_db.sqlalchemy.engines [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=123512) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 13:54:58.685568 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: WARNING keystonemiddleware.auth_token [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:54:58.693493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: WARNING keystonemiddleware.auth_token [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:54:58.710212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: WARNING keystonemiddleware.auth_token [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:54:58.717946 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: WARNING keystonemiddleware.auth_token [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:54:59.042401 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: WARNING keystonemiddleware.auth_token [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:54:59.048636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: WARNING keystonemiddleware.auth_token [None req-c0837964-0841-43fc-8e35-1f63799d8a18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:54:59.054628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557544c829c0 pid: 123511 (default app) May 13 13:54:59.082361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: WARNING keystonemiddleware.auth_token [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 13:54:59.088760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: WARNING keystonemiddleware.auth_token [None req-1563dadf-ee09-417f-8828-9d0bab6a115b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 13:54:59.094031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557544c829c0 pid: 123512 (default app) May 13 13:55:44.832132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6e724ae1-7b35-4250-a0fe-79c901454e2a tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Action: 'create', calling method: .version_select at 0x7fb3c055a280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1562090158", "metadata": {"Type": "work"}}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6e724ae1-7b35-4250-a0fe-79c901454e2a tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Request method failure captured: May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 122 May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNgwtge1LdQd5VaR8AU8jx_40q-URfD-4-fL9obVxFHwI7Jv09kh-pWFVqE-qku-DU-1O_5S7DDW-zEZKv-KPb_ft5wE186wKw0Ih6hpyFIhv2d4cK_79Wh-jh5sy1kwyOqPMFx-fM5XrEdrHy7cRDK7PRkS60G2fXFCbmVk_R51Ps May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:55:44.859364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesNegativeTest-671847479 May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesNegativeTest-671847479-project May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 4e94408aeb5d4f809419b3c7865224b2 May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesNegativeTest-671847479-project May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1562090158", "metadata": {"Type": "work"}}} May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: May 13 13:55:44.862941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1562090158', 'metadata': {'Type': 'work'}}}} May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise error May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi '#$%' May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:55:44.864750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:55:44.869118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:55:44.871865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 13:55:44.871865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:44.871865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6e724ae1-7b35-4250-a0fe-79c901454e2a tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:55:44.871865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6e724ae1-7b35-4250-a0fe-79c901454e2a tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.666744 May 13 13:55:44.871865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 1/1] 10.222.0.79 () {60 vars in 1155 bytes} [Fri May 13 13:55:44 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 669 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:55:45.675070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cef7703b-c6f7-4ec1-a5ce-9658acec3267 tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Action: 'create', calling method: .version_select at 0x7fb3c05e6ee0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-296589381", "metadata": {"Type": "work"}}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cef7703b-c6f7-4ec1-a5ce-9658acec3267 tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Request method failure captured: May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 119 May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNgwtge1LdQd5VaR8AU8jx_40q-URfD-4-fL9obVxFHwI7Jv09kh-pWFVqE-qku-DU-1O_5S7DDW-zEZKv-KPb_ft5wE186wKw0Ih6hpyFIhv2d4cK_79Wh-jh5sy1kwyOqPMFx-fM5XrEdrHy7cRDK7PRkS60G2fXFCbmVk_R51Ps May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:55:45.682952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesNegativeTest-671847479 May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesNegativeTest-671847479-project May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 4e94408aeb5d4f809419b3c7865224b2 May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesNegativeTest-671847479-project May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-296589381", "metadata": {"Type": "work"}}} May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: May 13 13:55:45.684815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-296589381', 'metadata': {'Type': 'work'}}}} May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise error May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi '0' May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:55:45.685664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:55:45.687152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:55:45.688219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 13:55:45.688219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:45.688219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cef7703b-c6f7-4ec1-a5ce-9658acec3267 tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:55:45.688219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cef7703b-c6f7-4ec1-a5ce-9658acec3267 tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.816058 May 13 13:55:45.695469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 1/2] 10.222.0.79 () {60 vars in 1155 bytes} [Fri May 13 13:55:44 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 827 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 13:55:45.700677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-306e9efe-55a5-4ac0-931f-10650e2d0dda tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Action: 'create', calling method: .version_select at 0x7fb3c03f75e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1309825121", "metadata": {"Type": "work"}}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-306e9efe-55a5-4ac0-931f-10650e2d0dda tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Request method failure captured: May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 119 May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNgwtge1LdQd5VaR8AU8jx_40q-URfD-4-fL9obVxFHwI7Jv09kh-pWFVqE-qku-DU-1O_5S7DDW-zEZKv-KPb_ft5wE186wKw0Ih6hpyFIhv2d4cK_79Wh-jh5sy1kwyOqPMFx-fM5XrEdrHy7cRDK7PRkS60G2fXFCbmVk_R51Ps May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:55:45.703941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesNegativeTest-671847479 May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesNegativeTest-671847479-project May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 4e94408aeb5d4f809419b3c7865224b2 May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesNegativeTest-671847479-project May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1309825121", "metadata": {"Type": "work"}}} May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: May 13 13:55:45.705939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1309825121', 'metadata': {'Type': 'work'}}}} May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise error May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi '' May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:55:45.707358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 13:55:45.708930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 13:55:45.710005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 13:55:45.710005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:45.716071 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-306e9efe-55a5-4ac0-931f-10650e2d0dda tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:55:45.717326 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-306e9efe-55a5-4ac0-931f-10650e2d0dda tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.021750 May 13 13:55:45.719773 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 2/3] 10.222.0.79 () {60 vars in 1155 bytes} [Fri May 13 13:55:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:55:45.735046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1e76d416-2a60-484b-a622-db945baee88f tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Calling method '.version_select at 0x7fb3c0442280>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:46.522109 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-1e76d416-2a60-484b-a622-db945baee88f tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] HTTP exception thrown: Volume tempest-invalid-1626614773 could not be found. May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1e76d416-2a60-484b-a622-db945baee88f tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Request method failure captured: May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1626614773 HTTP/1.1 May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNgwtge1LdQd5VaR8AU8jx_40q-URfD-4-fL9obVxFHwI7Jv09kh-pWFVqE-qku-DU-1O_5S7DDW-zEZKv-KPb_ft5wE186wKw0Ih6hpyFIhv2d4cK_79Wh-jh5sy1kwyOqPMFx-fM5XrEdrHy7cRDK7PRkS60G2fXFCbmVk_R51Ps May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:55:46.526088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesNegativeTest-671847479 May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesNegativeTest-671847479-project May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 4e94408aeb5d4f809419b3c7865224b2 May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesNegativeTest-671847479-project May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Volume tempest-invalid-1626614773 could not be found. May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'tempest-invalid-1626614773'} May 13 13:55:46.528374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1626614773 could not be found. (HTTP 404) (Request-ID: req-2e305f1d-b367-4af9-a27d-6f1c4a439416) May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:46.529660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:55:46.535447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1626614773 could not be found. May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:55:46.539309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1626614773 could not be found. May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1626614773 could not be found. May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1e76d416-2a60-484b-a622-db945baee88f tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Returning 404 to user: Volume tempest-invalid-1626614773 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1e76d416-2a60-484b-a622-db945baee88f tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1626614773" status: 404 len: 99 microversion: 2.1 time: 0.800202 May 13 13:55:46.549428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 2/4] 10.222.0.79 () {58 vars in 1217 bytes} [Fri May 13 13:55:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1626614773 => generated 99 bytes in 802 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 13:55:46.553994 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d487da30-a674-422f-a2e0-1d2d5164306d tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004471 May 13 13:55:46.553994 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 3/5] 10.222.0.79 () {58 vars in 1139 bytes} [Fri May 13 13:55:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 13:55:46.557256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-582d399d-2f0f-4199-a5a7-0d8786d00320 tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007118 May 13 13:55:46.557256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 3/6] 10.222.0.79 () {58 vars in 1136 bytes} [Fri May 13 13:55:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 13 13:55:46.571834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dfe56dff-9f4f-4777-8067-cfb552a928ee tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Calling method '.version_select at 0x7fb3c0ee9430>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:47.404599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-dfe56dff-9f4f-4777-8067-cfb552a928ee tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] HTTP exception thrown: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dfe56dff-9f4f-4777-8067-cfb552a928ee tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Request method failure captured: May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/os-volumes/f691e384-3fa5-4631-b077-c5b57328be34 HTTP/1.1 May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNgwtge1LdQd5VaR8AU8jx_40q-URfD-4-fL9obVxFHwI7Jv09kh-pWFVqE-qku-DU-1O_5S7DDW-zEZKv-KPb_ft5wE186wKw0Ih6hpyFIhv2d4cK_79Wh-jh5sy1kwyOqPMFx-fM5XrEdrHy7cRDK7PRkS60G2fXFCbmVk_R51Ps May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:55:47.410795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesNegativeTest-671847479 May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesNegativeTest-671847479-project May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 4e94408aeb5d4f809419b3c7865224b2 May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesNegativeTest-671847479-project May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'f691e384-3fa5-4631-b077-c5b57328be34'} May 13 13:55:47.412337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. (HTTP 404) (Request-ID: req-9540a486-a88c-4764-9745-a9688a0cf9ba) May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:47.413248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 13:55:47.414427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 13:55:47.415672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. May 13 13:55:47.416922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:55:47.421637 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dfe56dff-9f4f-4777-8067-cfb552a928ee tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Returning 404 to user: Volume f691e384-3fa5-4631-b077-c5b57328be34 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:55:47.422901 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dfe56dff-9f4f-4777-8067-cfb552a928ee tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/f691e384-3fa5-4631-b077-c5b57328be34" status: 404 len: 109 microversion: 2.1 time: 0.860024 May 13 13:55:47.428023 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 4/7] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 13:55:46 2022] DELETE /compute/v2.1/os-volumes/f691e384-3fa5-4631-b077-c5b57328be34 => generated 109 bytes in 866 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:55:47.454367 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b75e0105-d7ec-46a2-a60b-bed1a6f0dcdd tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Calling method '.version_select at 0x7fb3c038bee0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:47.531757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-b75e0105-d7ec-46a2-a60b-bed1a6f0dcdd tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] HTTP exception thrown: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b75e0105-d7ec-46a2-a60b-bed1a6f0dcdd tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Request method failure captured: May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/os-volumes/85461f0e-2915-4374-8d21-d984dd60c021 HTTP/1.1 May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNgwtge1LdQd5VaR8AU8jx_40q-URfD-4-fL9obVxFHwI7Jv09kh-pWFVqE-qku-DU-1O_5S7DDW-zEZKv-KPb_ft5wE186wKw0Ih6hpyFIhv2d4cK_79Wh-jh5sy1kwyOqPMFx-fM5XrEdrHy7cRDK7PRkS60G2fXFCbmVk_R51Ps May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:55:47.534445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_de17783e3b08413a88dd343eb4c4f28a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesNegativeTest-671847479 May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: de17783e3b08413a88dd343eb4c4f28a May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesNegativeTest-671847479 May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesNegativeTest-671847479-project May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 4e94408aeb5d4f809419b3c7865224b2 May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesNegativeTest-671847479-project May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '85461f0e-2915-4374-8d21-d984dd60c021'} May 13 13:55:47.536084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. (HTTP 404) (Request-ID: req-b1381918-d99a-4e95-b83b-7da08ede8104) May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:47.536944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 13:55:47.539688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 13:55:47.541953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b75e0105-d7ec-46a2-a60b-bed1a6f0dcdd tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] Returning 404 to user: Volume 85461f0e-2915-4374-8d21-d984dd60c021 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b75e0105-d7ec-46a2-a60b-bed1a6f0dcdd tempest-VolumesNegativeTest-671847479 tempest-VolumesNegativeTest-671847479-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/85461f0e-2915-4374-8d21-d984dd60c021" status: 404 len: 109 microversion: 2.1 time: 0.096420 May 13 13:55:47.545949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 4/8] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 13:55:47 2022] GET /compute/v2.1/os-volumes/85461f0e-2915-4374-8d21-d984dd60c021 => generated 109 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:55:50.221763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-552616184", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "networks": [{"uuid": "3de73a64-9208-445c-affd-c0841473ceb2"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:55:50.431855 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] validate_networks() for [('3de73a64-9208-445c-affd-c0841473ceb2', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:55:56.352088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:55:56.352763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:55:56.353113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:55:56.353500 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:55:56.354083 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:55:56.395980 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:56.398340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:56.405285 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:55:56.407028 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:55:56.513491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Getting quotas for project d42ea16d0ee64f398b01b206c1960b08. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:55:56.534265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Getting quotas for user 0622aea8005b4b82bcb921089974775d and project d42ea16d0ee64f398b01b206c1960b08. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:55:56.565797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:55:56.571607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:55:56.787459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ea889f79-76d5-4755-b2a6-068067560230 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.931118 May 13 13:55:56.797094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 5/9] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:55:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 6943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:55:56.813668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ce21d785-1680-4910-9c58-f6df4a90f848 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:56.817595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ce21d785-1680-4910-9c58-f6df4a90f848 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:57.505147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ce21d785-1680-4910-9c58-f6df4a90f848 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:57.525966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ce21d785-1680-4910-9c58-f6df4a90f848 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1214 microversion: 2.1 time: 0.727376 May 13 13:55:57.547862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 5/10] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:55:56 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1214 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:55:58.579001 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0642f641-4af4-488d-b797-4ae6e14a45de tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:55:58.579688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0642f641-4af4-488d-b797-4ae6e14a45de tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:55:58.959504 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0642f641-4af4-488d-b797-4ae6e14a45de tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:55:59.013459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0642f641-4af4-488d-b797-4ae6e14a45de tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1214 microversion: 2.1 time: 0.435844 May 13 13:55:59.018295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 6/11] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:55:58 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1214 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:00.043448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:00.044597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:00.072623 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:00.075207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:00.077026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:00.078605 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:00.890823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:00.916293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-36046783-4384-452b-806f-31840b29c89c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1210 microversion: 2.1 time: 0.885715 May 13 13:56:00.917438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 6/12] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:00 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1210 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:01.935313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:01.935939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:01.968142 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:01.968895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:01.970658 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:01.975338 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:02.355339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:02.376793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a7fac457-cd59-490a-ab96-8146a55decd5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1272 microversion: 2.1 time: 0.445590 May 13 13:56:02.381752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 7/13] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:01 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1272 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:03.399979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:03.400614 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:03.433241 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:03.434242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:03.437804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:03.439453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:03.862523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:03.882456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d9de54fa-7547-4a73-9311-55cda1414e84 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1272 microversion: 2.1 time: 0.486797 May 13 13:56:03.889770 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 7/14] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:03 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1272 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:04.696000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c7e6bc19-5f91-48a8-aed0-171ede1507e1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: .version_select at 0x7fb3bf1eba60>, body: {"keypair": {"name": "tempest-keypair-242125846", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMcO79j1m/ML8M6UNnDaNbttca9B4c68FGTy9mgMFSpYGHKAzYazmmZ86wgbEeLSFS0w33VuHLOsmn3jInivGZLR7gnvGIAZ3XUL/E85LXo2zdNc9ZbN7/iyxcaD5aMFA=="}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:04.789667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-c7e6bc19-5f91-48a8-aed0-171ede1507e1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:04.832242 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-c7e6bc19-5f91-48a8-aed0-171ede1507e1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:04.910277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:04.911133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:04.945115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:04.947247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:04.949312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:04.953369 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:04.998132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c7e6bc19-5f91-48a8-aed0-171ede1507e1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.966620 May 13 13:56:05.005977 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 8/15] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 13:56:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:56:05.286318 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:05.307524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3e724bd0-c838-4ddd-a3ee-a5dd921ce2a5 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1272 microversion: 2.1 time: 0.402786 May 13 13:56:05.311598 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 8/16] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:04 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1272 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:06.328674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:06.329704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:06.338137 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:06.339043 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:06.341307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:06.342420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:06.814787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:06.836797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-574f57a4-cad8-4abb-b779-da7e3a21f7dd tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1272 microversion: 2.1 time: 0.510020 May 13 13:56:06.837461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 9/17] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:06 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1272 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:07.859675 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:07.860840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:07.882172 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:07.882637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:07.891098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:07.899309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:08.307029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:08.320885 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c8c94ff9-b62b-414b-9b6b-a1136d85efb2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1272 microversion: 2.1 time: 0.465091 May 13 13:56:08.328305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 9/18] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:07 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1272 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:09.346236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:09.347987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:09.366245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:09.367242 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:09.368372 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:09.369098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:10.143597 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:10.153995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bc2aa152-1864-4e63-b3b0-62b29886ae98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.812967 May 13 13:56:10.165830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 10/19] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:09 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:11.182174 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:11.183771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:11.186538 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-037dd684-f12b-4c3f-b829-baf9c937173b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: .version_select at 0x7fb3c0251f70>, body: {"keypair": {"name": "tempest-keypair-1601437673", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+6ms2igCLSFHuX0GSjbtGYEx2m2bMfhVdKcrUzNPVMTOgLwpNB9lB4DY4cG4zv1IxVnQ2Bl/QoQWEJ8xomCwKX/7KnUNNUYeRReDUkS/m76bzMjbYaOamOwv9pze++5g=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:11.196733 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:11.197299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:11.198103 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:11.198551 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:11.358307 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-037dd684-f12b-4c3f-b829-baf9c937173b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for project ef87180052d643af940a8e2b4f21e46f. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:11.392059 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-037dd684-f12b-4c3f-b829-baf9c937173b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for user a37f5d5ddd9845fbaf7d5645c31b2d40 and project ef87180052d643af940a8e2b4f21e46f. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:11.608917 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-037dd684-f12b-4c3f-b829-baf9c937173b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.055532 May 13 13:56:11.612890 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 10/20] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 13:56:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:11.936680 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:11.961331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-10063e18-1832-4429-8249-13c6a3ad3b98 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.781637 May 13 13:56:11.966135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 11/21] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:11 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:12.983775 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:12.984621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:13.007742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.008211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.009019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:13.009469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:13.218135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2110688824", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed6b2694-1b8c-422b-965c-287402920164"}], "security_groups": [{"name": "tempest-securitygroup--179121739"}], "key_name": "tempest-keypair-242125846", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:13.971248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:13.993244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f12b9612-d556-4c04-8ec4-4eed36de75db tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 1.015482 May 13 13:56:13.994213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 11/22] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:12 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:14.123044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] validate_networks() for [('ed6b2694-1b8c-422b-965c-287402920164', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:56:15.014121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:15.015440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:15.030188 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:15.030882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:15.032010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:15.040829 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:15.518574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:15.554275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-480f1205-a752-4734-ad89-ebfa5aac9a78 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.546129 May 13 13:56:15.573956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 12/23] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:15 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:16.333728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:56:16.334434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:56:16.334731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:56:16.335061 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:56:16.335505 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:56:16.357487 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:16.358548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:16.363451 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:16.365876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:16.411924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:16.418043 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:16.435368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:56:16.445421 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:56:16.596013 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:16.597831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:16.623711 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:16.624595 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3e5b6df2-0ea2-44e1-9ed5-4114f4b5a4e5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.404765 May 13 13:56:16.630541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 12/24] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:56:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 3419 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:56:16.639147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:16.646257 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:16.649252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:17.537391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b10928c3-cfec-4416-9e03-c5e83865ea94 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'create', calling method: .version_select at 0x7fb3be8e8310>, body: {"keypair": {"name": "tempest-keypair-192943633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI7VVPYQcCz/RmFlqYknjIV9Ij0BbewSkAMB7pqxcx8ySMUC0WslRFQNR3AkiCH3dKkkQhIYxAunPh0ottxIw1OtuQ9MFKAceB8qx9cxI2k63IbvxpgTWWu5QlgrzLDZXg=="}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:17.562852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-b10928c3-cfec-4416-9e03-c5e83865ea94 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'key_pairs'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:17.581659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:17.589169 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-b10928c3-cfec-4416-9e03-c5e83865ea94 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for user 8b2980196e0f4fafa5131dd5de02ac75 and project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'key_pairs'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:17.590690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-94c967ae-8a92-4433-83c3-7503aec24b6f tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 1.002086 May 13 13:56:17.591381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 13/25] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:16 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:17.607252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-568d243f-c10f-4579-aadb-54ed543c25f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:17.618218 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-568d243f-c10f-4579-aadb-54ed543c25f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:17.647772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b10928c3-cfec-4416-9e03-c5e83865ea94 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.015289 May 13 13:56:17.657246 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 13/26] 10.222.0.79 () {62 vars in 1199 bytes} [Fri May 13 13:56:16 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1026 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 13:56:18.041774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-568d243f-c10f-4579-aadb-54ed543c25f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:18.050437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-568d243f-c10f-4579-aadb-54ed543c25f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1241 microversion: 2.1 time: 0.457968 May 13 13:56:18.064881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 14/27] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:17 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1241 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:18.425636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-05109cb1-f5f6-4699-b4e5-95641ee1b8f2 req-13edc372-d765-42a2-b5c5-0a390de87846 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9d8a733-ab35-4501-9946-8035d5af171d", "tag": "d7ba6f79-08c4-491c-92f8-2ea6a96ad92b"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:18.491335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-05109cb1-f5f6-4699-b4e5-95641ee1b8f2 req-13edc372-d765-42a2-b5c5-0a390de87846 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.491924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-05109cb1-f5f6-4699-b4e5-95641ee1b8f2 req-13edc372-d765-42a2-b5c5-0a390de87846 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.608831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:18.610221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:18.610740 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-05109cb1-f5f6-4699-b4e5-95641ee1b8f2 req-13edc372-d765-42a2-b5c5-0a390de87846 service nova] Creating event network-changed:d7ba6f79-08c4-491c-92f8-2ea6a96ad92b for instance e9d8a733-ab35-4501-9946-8035d5af171d on hv-cinder-84175 May 13 13:56:18.611427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-05109cb1-f5f6-4699-b4e5-95641ee1b8f2 req-13edc372-d765-42a2-b5c5-0a390de87846 service nova] Acquired lock "compute-rpcapi-router" {{(pid=123511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:56:18.612561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.618822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.619872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.620575 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.630096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.630555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.631399 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:18.631848 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:18.668663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.compute.rpcapi [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:56:18.678207 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] Releasing lock "compute-rpcapi-router" {{(pid=123511) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:56:18.745900 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-54ea8f20-fa91-4598-85bb-6d9b98ed528d None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553489 May 13 13:56:18.749895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 14/28] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:19.070883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:19.071611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:19.082841 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:19.087778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:19.089020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:19.091616 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:19.355767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:19.361561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:19.371688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ef34b16b-4d2a-4dcb-86ee-05b26770e214 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.762720 May 13 13:56:19.372368 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 15/29] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:18 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:19.392555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-15201769-4e73-40ab-88fa-431366ee26be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1245 microversion: 2.1 time: 0.326174 May 13 13:56:19.394185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 15/30] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:19 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1245 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:20.402370 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:20.405298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:20.415018 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:20.416549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:20.421123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.424736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.427698 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.429043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.460534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.460936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.477665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:20.478139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:20.788330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:20.818297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-125fdc62-05a8-4dda-94bd-55f00ef96e33 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1245 microversion: 2.1 time: 0.411563 May 13 13:56:20.825795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 16/31] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:20 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1245 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:21.201206 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:21.244390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-908036877", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:21.254012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4cce5cde-0853-4fb4-82fc-921fb1c968c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.864829 May 13 13:56:21.259154 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 16/32] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:20 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:21.431126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] validate_networks() for [('37774d91-9a21-4c82-acd7-acc4b660f52e', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:56:21.846613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:21.848128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:21.870414 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.871278 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:21.884173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:21.885437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.657047 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:22.670576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5a0160a3-2ad1-44c8-b74a-7af0f13c658b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1293 microversion: 2.1 time: 0.828099 May 13 13:56:22.672502 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 17/33] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:21 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1293 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:22.682550 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:22.683486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:22.710326 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.711078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:22.712014 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:22.715857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:23.880414 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:23.888597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1bcde596-a839-45c1-a2a6-a5d8e4aad619 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 1.213966 May 13 13:56:23.889199 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 18/34] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:22 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:23.916945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:23.917836 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:23.931683 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:23.943625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:23.944328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:23.944778 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.065955 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:24.081506 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2bd1117e-f4c3-4be9-84d2-29de1e16a16b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1299 microversion: 2.1 time: 0.182549 May 13 13:56:24.082316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 19/35] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:23 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1299 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:24.088135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1968799747", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "447dd757-4541-46df-a762-b636f2945abd"}], "security_groups": [{"name": "tempest-securitygroup--2100910525"}], "key_name": "tempest-keypair-1601437673", "user_data": "}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:24.454285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] validate_networks() for [('447dd757-4541-46df-a762-b636f2945abd', None, None, None, None, None)] {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:56:24.773342 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:56:24.774200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:56:24.775273 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:56:24.776148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:56:24.777127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:56:24.838978 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:24.848613 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.848613 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:24.849242 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:24.918449 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for project ef89791b177f4bf0ba916f133c79f33a. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:24.942765 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for user 20fd230cc30f4980bedebc75c620d707 and project ef89791b177f4bf0ba916f133c79f33a. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:24.981151 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:56:24.987541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:56:25.128937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d9e655cd-2b93-42e3-ae1b-4a909f3e212e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.301011 May 13 13:56:25.144380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 17/36] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:56:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 4317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:56:25.152352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1271004815", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d31cc72a-07f0-4e46-83ba-2f51500ae3d4"}], "security_groups": [{"name": "tempest-securitygroup--760256984"}], "key_name": "tempest-keypair-192943633", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:25.641695 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] validate_networks() for [('d31cc72a-07f0-4e46-83ba-2f51500ae3d4', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:56:27.215609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:56:27.216252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:56:27.217689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:56:27.217689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:56:27.219337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:56:27.242793 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.243379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:27.244322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.245059 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:27.274045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for project ef87180052d643af940a8e2b4f21e46f. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:27.280166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for user a37f5d5ddd9845fbaf7d5645c31b2d40 and project ef87180052d643af940a8e2b4f21e46f. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:27.313202 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:56:27.319074 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:56:27.454460 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4124f880-e15f-409f-a05a-4853fd27ca24 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.369631 May 13 13:56:27.455813 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 20/37] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:56:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 3373 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:56:27.474996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:27.475743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:27.491406 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.492410 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:27.493774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:27.497993 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.116390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:56:28.116764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:56:28.117250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:56:28.117761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:56:28.118274 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:56:28.129959 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.130823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.132438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.133168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.160350 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:28.166411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for user 8b2980196e0f4fafa5131dd5de02ac75 and project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:28.189925 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:56:28.194656 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:56:28.343048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:28.357912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c0fbfa4f-ddbe-4802-990f-b6ff7493bf5d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.898575 May 13 13:56:28.360909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 21/38] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:27 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:28.388524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:28.389826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:28.405863 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.407079 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.408798 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.409596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.437774 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d4de543b-492d-4f84-b2a4-86f951ef3433 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.291367 May 13 13:56:28.441459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 18/39] 10.222.0.79 () {62 vars in 1187 bytes} [Fri May 13 13:56:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 3296 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 13:56:28.460691 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:28.465047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:28.494016 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.494479 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.500676 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.502383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.707350 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:28.719593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d7bec908-572f-44ab-b6ef-72b3c4bf8c9b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1279 microversion: 2.1 time: 0.274847 May 13 13:56:28.723058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 19/40] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:28 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1279 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:28.739030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:28.739983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:28.753579 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.754296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:28.755289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:28.755901 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:29.108170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:29.117511 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-408a6ead-fdf0-4d4a-b24e-b55564901bfa tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1242 microversion: 2.1 time: 0.392466 May 13 13:56:29.118540 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 20/41] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:28 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1242 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:29.145187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1045997238", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "networks": [{"uuid": "fa0dc286-b2aa-44ba-a34e-5eec53911313"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:29.245123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] validate_networks() for [('fa0dc286-b2aa-44ba-a34e-5eec53911313', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:56:29.462375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:29.473321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5e2ecea3-4513-4f49-861a-17584650a4a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 1.110521 May 13 13:56:29.486036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 22/42] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:28 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:29.492210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-13e119d4-7d20-415b-b8c2-56486c434600 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:29.503022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-13e119d4-7d20-415b-b8c2-56486c434600 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:29.745905 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-13e119d4-7d20-415b-b8c2-56486c434600 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:29.766811 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-13e119d4-7d20-415b-b8c2-56486c434600 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:29.774578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-13e119d4-7d20-415b-b8c2-56486c434600 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:29.779968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-13e119d4-7d20-415b-b8c2-56486c434600 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1281 microversion: 2.20 time: 0.292510 May 13 13:56:29.783645 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 23/43] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:29 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1281 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:29.804253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1155631598", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:29.943040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] validate_networks() for [('37774d91-9a21-4c82-acd7-acc4b660f52e', None, None, None, None, None)] {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:56:30.577298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:56:30.578032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:56:30.578394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:56:30.578824 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:56:30.579432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:56:30.601257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:30.602008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:30.603371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:30.604158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:30.634098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Getting quotas for project 703aa4774820401da920e420eb6181d9. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:30.639381 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Getting quotas for user 8ef0eaa76ffe4b62a132f0f4ee595a6f and project 703aa4774820401da920e420eb6181d9. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:30.657855 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:56:30.660635 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:56:30.737027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bcf57255-5bcf-41dc-a581-5af83b405c76 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.617811 May 13 13:56:30.745787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 21/44] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:56:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:56:30.758250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:30.761816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:30.776180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:30.777007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:30.778167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:30.778832 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.353582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:31.364777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-137ea90c-fc0b-4675-b300-604251e65977 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.617083 May 13 13:56:31.366110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 22/45] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:30 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:31.772506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-417286d4-5916-4775-82b0-5bf5e005bcf7 req-a0b14c59-45cf-4e81-a674-a1a8cf1cf58e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d8a733-ab35-4501-9946-8035d5af171d", "name": "network-vif-plugged", "status": "completed", "tag": "d7ba6f79-08c4-491c-92f8-2ea6a96ad92b"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:31.818537 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-417286d4-5916-4775-82b0-5bf5e005bcf7 req-a0b14c59-45cf-4e81-a674-a1a8cf1cf58e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.824485 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-417286d4-5916-4775-82b0-5bf5e005bcf7 req-a0b14c59-45cf-4e81-a674-a1a8cf1cf58e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.880912 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-417286d4-5916-4775-82b0-5bf5e005bcf7 req-a0b14c59-45cf-4e81-a674-a1a8cf1cf58e service nova] Creating event network-vif-plugged:d7ba6f79-08c4-491c-92f8-2ea6a96ad92b for instance e9d8a733-ab35-4501-9946-8035d5af171d on hv-cinder-84175 May 13 13:56:31.892468 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-417286d4-5916-4775-82b0-5bf5e005bcf7 req-a0b14c59-45cf-4e81-a674-a1a8cf1cf58e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.524130 May 13 13:56:31.894245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 23/46] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:31.910236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:31.911986 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:31.923359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.923772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:31.924692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:31.925307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.089419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:56:32.090631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:56:32.091498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:56:32.092819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:56:32.093479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:56:32.113065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.113748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.114728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.116971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.163299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:32.174627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8f1f6c46-d2bc-4873-bdea-d7e86e64b13a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1296 microversion: 2.1 time: 0.275304 May 13 13:56:32.175489 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 24/47] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:31 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1296 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:32.194764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:32.195692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:32.202550 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for project ef89791b177f4bf0ba916f133c79f33a. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:56:32.205776 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.206490 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.207600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.208206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.215070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for user 20fd230cc30f4980bedebc75c620d707 and project ef89791b177f4bf0ba916f133c79f33a. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:56:32.247737 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:56:32.250646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:56:32.351329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-473a68f1-7309-4741-a128-f1855bf5fd5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.565587 May 13 13:56:32.357482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 24/48] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:56:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 2573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:56:32.380190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:32.382962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:32.393697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.394450 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.395513 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.396314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.691748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:32.741242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-06c70143-d57a-4c5e-b669-03e5ef398cbb tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1266 microversion: 2.1 time: 0.380728 May 13 13:56:32.748084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 25/49] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:32 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1266 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:32.776492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:32.809966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:32.824191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.825408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:32.826929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:32.830471 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.365123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:33.405014 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:33.416257 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:33.419881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-afd96067-b9ff-4849-bcc8-8231fe1af177 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1339 microversion: 2.20 time: 0.666642 May 13 13:56:33.446841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 26/50] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:32 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1339 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:33.463755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:33.464803 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:33.475848 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.476668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.479591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.480579 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.598544 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:33.630639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4a915fc8-823e-4317-a354-741cdbe27ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 1.453567 May 13 13:56:33.634112 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 25/51] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:32 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 1458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:33.647681 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:33.649495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:33.661446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.662554 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.664243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.665243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.820027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:33.845451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-249add06-fcd8-4c16-b98d-34c6f0d66076 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1226 microversion: 2.1 time: 0.394416 May 13 13:56:33.852330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 27/52] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:33 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1226 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:33.864235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-e133cdcb-8dcc-4d38-af13-551a82a920af req-3fb4309a-d167-471c-9f15-5a9a798d8f8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c44ce14-5d23-453e-bfde-1fb8c8d74c2a", "tag": "ce3869b7-d2b1-485b-b44b-6654613759f1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:33.881761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-e133cdcb-8dcc-4d38-af13-551a82a920af req-3fb4309a-d167-471c-9f15-5a9a798d8f8d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.885147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-e133cdcb-8dcc-4d38-af13-551a82a920af req-3fb4309a-d167-471c-9f15-5a9a798d8f8d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.928062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-e133cdcb-8dcc-4d38-af13-551a82a920af req-3fb4309a-d167-471c-9f15-5a9a798d8f8d service nova] Creating event network-changed:ce3869b7-d2b1-485b-b44b-6654613759f1 for instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a on hv-cinder-84175 May 13 13:56:33.928062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-e133cdcb-8dcc-4d38-af13-551a82a920af req-3fb4309a-d167-471c-9f15-5a9a798d8f8d service nova] Acquired lock "compute-rpcapi-router" {{(pid=123512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 13:56:33.928062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.929557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.930817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:33.931907 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:33.950111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.compute.rpcapi [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 13:56:33.951810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] Releasing lock "compute-rpcapi-router" {{(pid=123512) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 13:56:33.991733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-aa26dba8-7fa2-474e-8ee6-0f05cf4a2f96 None None] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135561 May 13 13:56:33.994199 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 28/53] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:34.005754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:34.007358 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:34.019404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.020485 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.022692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.023737 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.070590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.080195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-eaf5bede-61b8-43c3-8956-9bd8be323366 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.441738 May 13 13:56:34.081377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 26/54] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:33 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:34.205406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-01658380-1953-4f58-a008-e53d03eb8037 req-6a1bb8aa-d240-44cb-a3b9-06e392a91247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5fb9024-5080-4527-b9ac-55f60dbccd8a", "tag": "504a7fcd-a3fa-4e91-ae56-90416b5e697f"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:34.214019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-01658380-1953-4f58-a008-e53d03eb8037 req-6a1bb8aa-d240-44cb-a3b9-06e392a91247 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.214565 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-01658380-1953-4f58-a008-e53d03eb8037 req-6a1bb8aa-d240-44cb-a3b9-06e392a91247 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.227364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-01658380-1953-4f58-a008-e53d03eb8037 req-6a1bb8aa-d240-44cb-a3b9-06e392a91247 service nova] Creating event network-changed:504a7fcd-a3fa-4e91-ae56-90416b5e697f for instance c5fb9024-5080-4527-b9ac-55f60dbccd8a on hv-cinder-84175 May 13 13:56:34.233588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-01658380-1953-4f58-a008-e53d03eb8037 req-6a1bb8aa-d240-44cb-a3b9-06e392a91247 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.150710 May 13 13:56:34.234886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 27/55] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:34.240364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:34.241212 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:34.248900 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.250179 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.251334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.251957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.345564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.361599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.363017 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fff9582d-c5b7-4443-b24f-c30c42502cbc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.365906 May 13 13:56:34.364075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 29/56] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:33 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:34.374093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a467f471-b52c-4fa0-865b-e40ad30e49cc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1272 microversion: 2.1 time: 0.137490 May 13 13:56:34.375269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 28/57] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:34 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1272 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:34.448079 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:34.448740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:34.455078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.455540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.456343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.456785 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.631325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.643445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.645390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.647512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1e159822-e5f4-4f00-8bb6-fe02dbb726c2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.202646 May 13 13:56:34.647675 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 30/58] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:34 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:34.663630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:34.664229 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:34.671436 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.672167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.673110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.673691 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.855416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.865908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8a3ae020-b252-400f-90d9-8338eb6297d8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.206231 May 13 13:56:34.867551 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:34.868177 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:34.876620 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 29/59] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:34 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:34.878126 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.878581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.879729 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:34.880003 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:34.984417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:34.997612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b5e2a6aa-1698-41db-a102-749a8ea0291f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1274 microversion: 2.1 time: 0.135672 May 13 13:56:34.998593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 31/60] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:34 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1274 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:35.105603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:35.106321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:35.113445 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.113907 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.114700 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.115217 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.268483 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:35.277486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a383ce0d-1ea9-4961-adba-6d7695457211 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.175673 May 13 13:56:35.278092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 30/61] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:35 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:35.382108 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:35.382634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:35.389107 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.389542 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.390352 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.390821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.404548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:35.405288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:35.412030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.412481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.413260 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.413873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.507413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:35.519955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-faf4f20f-56cb-42cb-aa08-2edd3752654e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1272 microversion: 2.1 time: 0.122658 May 13 13:56:35.521267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 31/62] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:35 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1272 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:35.579340 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:35.587469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2327ae5e-b668-404a-a14c-9cf0346388b5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.209390 May 13 13:56:35.588492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 32/63] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:35 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:35.672250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:35.673307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:35.680388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.680858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.681650 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.682093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.831869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:35.840175 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:35.841693 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:35.842847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-18e8a14b-afe2-4dd4-aa70-ce253ddaad55 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.179226 May 13 13:56:35.843938 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 32/64] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:35 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:35.884299 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:35.885073 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:35.891450 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.891952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:35.892691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:35.893129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.015875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:36.016505 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:36.022961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.023422 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.024224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.024668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.035971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:36.043912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-517135f3-4df4-4e11-a0cc-9d7f219445df tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.163824 May 13 13:56:36.044599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 33/65] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:35 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:36.054249 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-16bdee11-cf76-4d2a-a445-6888fdd4a0ca req-0131cdcd-6803-4bf6-b570-25de5ab4c721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596ea3e4-5857-40b2-82e2-84c63e19f7da", "tag": "0cddf8e8-d022-4c17-bc59-86e111fd692f"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:36.063126 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-16bdee11-cf76-4d2a-a445-6888fdd4a0ca req-0131cdcd-6803-4bf6-b570-25de5ab4c721 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.063572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-16bdee11-cf76-4d2a-a445-6888fdd4a0ca req-0131cdcd-6803-4bf6-b570-25de5ab4c721 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.075998 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-16bdee11-cf76-4d2a-a445-6888fdd4a0ca req-0131cdcd-6803-4bf6-b570-25de5ab4c721 service nova] Creating event network-changed:0cddf8e8-d022-4c17-bc59-86e111fd692f for instance 596ea3e4-5857-40b2-82e2-84c63e19f7da on hv-cinder-84175 May 13 13:56:36.090491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-16bdee11-cf76-4d2a-a445-6888fdd4a0ca req-0131cdcd-6803-4bf6-b570-25de5ab4c721 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039946 May 13 13:56:36.091357 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 34/66] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:36.115987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:36.124316 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dc44e958-a12d-4fd8-9cfa-649435440a9d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1274 microversion: 2.1 time: 0.112257 May 13 13:56:36.125045 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 33/67] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:36 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:36.300350 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:36.301563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:36.312883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.313699 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.314870 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.315878 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.504274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:36.512617 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-41b23808-6170-4485-b8d6-6bda14e42872 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.216471 May 13 13:56:36.513497 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 35/68] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:36 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:36.540192 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:36.540902 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:36.547648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.548089 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.548875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.549391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.605612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:36.606230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:36.613149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.613587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.614431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.614950 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.634590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:36.648823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9ee00656-7eb3-4a2f-af47-1ff8e60691a4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1272 microversion: 2.1 time: 0.112881 May 13 13:56:36.649924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 34/69] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:36 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1272 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:36.790276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:36.800179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ad824c0c-9e71-4799-ae42-58472069ff58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.198418 May 13 13:56:36.801238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 36/70] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:36 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:36.868455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:36.869183 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:36.880969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.881443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:36.882259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:36.882746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.076640 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:37.077046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:37.084887 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.085612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.086739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.087229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.536081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:37.547337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:37.549291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:37.550644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a2db88a3-7a37-43ef-9df3-8ad4c5cbe669 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.689929 May 13 13:56:37.551922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 35/71] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:36 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:37.559123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:37.560380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:37.566905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.567731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.568911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.569504 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.694619 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:37.704834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:37.713745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ca7d71a1-2f75-498e-af84-0cd6e5888291 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.643090 May 13 13:56:37.714364 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 37/72] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:37 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:37.715199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2d77b65c-e39c-4bf0-8a46-45b8f69b1132 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1274 microversion: 2.1 time: 0.161509 May 13 13:56:37.715798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 36/73] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:37 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1274 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:37.721474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:37.722659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:37.727809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:37.728720 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:37.729981 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.730665 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.732314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.733077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.744653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.745347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.746367 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.747031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.879091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:37.887237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c5734b39-97f6-4e19-a519-915b5a41792b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1272 microversion: 2.1 time: 0.170332 May 13 13:56:37.897268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 37/74] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:37 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:37.897268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:37.897268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:37.900432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.900884 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:37.901685 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:37.902122 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.202315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:38.209615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:38.210759 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-826f0252-e443-44d0-8705-a9f6ab04d62d tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1314 microversion: 2.1 time: 0.494042 May 13 13:56:38.211426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 38/75] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:37 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1314 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:38.217239 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-05c5e00a-bea0-469e-8e1f-936c77bbba96 req-ef07bbbf-d153-4a14-bd21-0cf8f16c9117 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:38.219743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ebec8aaf-8f90-4019-9540-79a762f43df9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.330699 May 13 13:56:38.221337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 38/76] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:37 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:38.229264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-05c5e00a-bea0-469e-8e1f-936c77bbba96 req-ef07bbbf-d153-4a14-bd21-0cf8f16c9117 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.230104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-05c5e00a-bea0-469e-8e1f-936c77bbba96 req-ef07bbbf-d153-4a14-bd21-0cf8f16c9117 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.242601 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-05c5e00a-bea0-469e-8e1f-936c77bbba96 req-ef07bbbf-d153-4a14-bd21-0cf8f16c9117 service nova] Creating event network-changed:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 13:56:38.247672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-05c5e00a-bea0-469e-8e1f-936c77bbba96 req-ef07bbbf-d153-4a14-bd21-0cf8f16c9117 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034641 May 13 13:56:38.248286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 39/77] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:38.571125 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:38.571739 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:38.578878 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.579502 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.580385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.580902 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.743922 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:38.745977 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:38.757053 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:38.762012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.763124 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.767246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.768666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.769077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:38.770639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:38.771837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-14eb8652-2304-4ad3-9ddc-2036a6a54707 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.204779 May 13 13:56:38.772592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 39/78] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:38 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:38.777429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:38.778042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:38.791397 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.791857 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.792846 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.793865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.877558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:38.896668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4326098d-89d8-4a7c-8329-7af4b4a0575c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1274 microversion: 2.1 time: 0.165157 May 13 13:56:38.899622 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 40/79] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:38 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1274 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:38.915753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:38.916930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:38.928410 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.929497 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.931784 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:38.932867 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:38.994200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:39.007624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-90e3b674-4207-4f01-b178-e47fb0bf5f92 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.233764 May 13 13:56:39.008601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 40/80] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:38 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:39.118412 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:39.132984 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bfdfed61-7eb9-491a-aaab-6806fa10967b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.230779 May 13 13:56:39.134671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 41/81] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:38 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:39.240139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:39.244032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:39.257174 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:39.264100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:39.269438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.274636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.276785 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.277743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.289585 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.294650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.302364 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.303591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.830323 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:39.839219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:39.845419 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-649e2997-fbc1-49c0-8979-cde08ba48f77 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1502 microversion: 2.1 time: 0.618667 May 13 13:56:39.858994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-86773267-ca35-45a8-a42c-5bce62262f92 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.607134 May 13 13:56:39.860180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 41/83] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:39 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1502 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:39.862801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 42/83] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:39 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:39.866016 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:39.866567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:39.873279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.873823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.875838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.875838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.916183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:39.917117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:39.927151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.927901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:39.928913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:39.930402 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.043274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:40.055682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2fa33954-fa79-48a3-bb27-2fd07f5701f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1282 microversion: 2.1 time: 0.143275 May 13 13:56:40.056953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 43/84] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:39 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:40.073965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:40.074615 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:40.082332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.082886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.083933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.084506 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.122896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:40.134371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:40.136374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:40.138665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d0301b07-d675-4b56-a623-8c43dc878267 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.277277 May 13 13:56:40.139953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 42/85] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:39 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:40.153159 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:40.154977 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:40.161995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.162662 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.163651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.164461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.449893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:40.459509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3cdf5e96-99bd-40ac-8791-1bf386afdc47 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.310872 May 13 13:56:40.460096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 43/86] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:40 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:40.462261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:40.471865 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-235fda49-7f4d-4bbf-9ece-a1ebef880d95 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.412842 May 13 13:56:40.473162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 44/87] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:40 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:40.685813 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-810ba66e-79ca-4b9a-85f0-e33556d2f8f1 req-9f4589f3-95a9-4e4e-a67a-74edf57cb133 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55e31b14-12b5-422b-b04a-c37a030d7859", "tag": "752c852e-22e0-45b9-a24e-da001a8775e3"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:40.694248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-810ba66e-79ca-4b9a-85f0-e33556d2f8f1 req-9f4589f3-95a9-4e4e-a67a-74edf57cb133 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.694959 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-810ba66e-79ca-4b9a-85f0-e33556d2f8f1 req-9f4589f3-95a9-4e4e-a67a-74edf57cb133 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.707264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-810ba66e-79ca-4b9a-85f0-e33556d2f8f1 req-9f4589f3-95a9-4e4e-a67a-74edf57cb133 service nova] Creating event network-changed:752c852e-22e0-45b9-a24e-da001a8775e3 for instance 55e31b14-12b5-422b-b04a-c37a030d7859 on hv-cinder-84175 May 13 13:56:40.712221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-810ba66e-79ca-4b9a-85f0-e33556d2f8f1 req-9f4589f3-95a9-4e4e-a67a-74edf57cb133 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030347 May 13 13:56:40.712828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 44/88] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:40.869723 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:40.870336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:40.877920 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.878687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:40.880077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:40.880834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.025140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.032346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-520bcbfd-6f3e-4225-bb58-37a4dd95f2bd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.166829 May 13 13:56:41.032927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 45/89] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:40 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:41.074033 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:41.074815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:41.081909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.082351 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.083165 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.083600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.156237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.159060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:41.159692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:41.166011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.166477 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.167316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.167760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.171316 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6103232f-4e20-4f54-9f1e-216518dcf9fe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1282 microversion: 2.1 time: 0.100886 May 13 13:56:41.172686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 45/90] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:41 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:41.335486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.351164 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.353913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.355641 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cd36bf8f-f858-4e67-a18e-d6485f602217 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.201690 May 13 13:56:41.357320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 46/91] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:41 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:41.477370 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:41.477982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:41.486234 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.487281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.488324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.488836 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.491063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:41.491690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:41.500185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.500956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.505455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:41.506348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:41.690812 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.699542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ecd1fd99-07e2-4992-843a-15dbdf01509b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.226052 May 13 13:56:41.700116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 46/92] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:41 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:41.716753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:41.724575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-81da8f46-8aa3-4f86-b637-740f3a63b68d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.238177 May 13 13:56:41.725151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 47/93] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:41 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:42.049787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:42.050398 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:42.056779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.057241 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.058275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.058737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.188943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.190082 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:42.190804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:42.197078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-255cf712-ea8b-4d44-b20d-97afba01616e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.151694 May 13 13:56:42.197438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.204028 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.204321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 47/94] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:42 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:42.204408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.204408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.268351 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.276690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2620616b-3dba-4073-ab56-aa80568fa271 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1282 microversion: 2.1 time: 0.090585 May 13 13:56:42.277464 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 48/95] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:42 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1282 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:42.387934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:42.388761 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:42.402335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.402335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.402335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.402335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.532745 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.540923 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.542410 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.543527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-014bf402-17ee-46f5-a591-1dba5f8113b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.159747 May 13 13:56:42.544113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 48/96] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:42 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:42.715828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:42.716344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:42.722397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.722883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.723655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.724090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.746389 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:42.747261 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:42.756178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.756633 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.757655 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:42.758080 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:42.928821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.937697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-473bdc33-3f4a-47d1-9c5e-932fcb21c641 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.225718 May 13 13:56:42.938272 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 49/97] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:42 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:42.941116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:42.948593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-23b36b82-d9cd-4eb4-97c9-fcc1ca40bdba tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.209933 May 13 13:56:42.949165 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 49/98] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:42 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:43.214025 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:43.214629 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:43.220680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.221134 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.221966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.222403 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.302534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:43.303789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:43.314864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.316187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.317017 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.318149 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.390424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:43.395042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:43.399152 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5efd28ed-6e84-4870-9de1-ba1a81c03c33 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1282 microversion: 2.1 time: 0.107048 May 13 13:56:43.399861 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 50/99] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:43 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1282 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:43.405640 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dd4af91b-2589-4a48-a542-0ebd37872c77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.195114 May 13 13:56:43.416201 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 50/100] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:43 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:43.459512 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90cbb328-41eb-43e1-8f30-e3e7b192cc86"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:43.460623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:43.466610 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.467275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.468666 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.469233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.560701 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:43.561993 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:43.568975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.569626 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.570589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.571066 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.724835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:43.732607 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:43.734606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:43.735762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a65234ed-ee85-4cee-bd31-21ecd6479596 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.179268 May 13 13:56:43.736323 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 51/101] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:43 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:43.954520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:43.955165 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:43.962425 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.963166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:43.965329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:43.965852 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.096628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.103951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c33087a0-20ca-4da4-8ce7-b4d063688e4a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.153528 May 13 13:56:44.104523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 52/102] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:43 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:44.109446 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:44.110050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:44.115611 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.116067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.116837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.117274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.246649 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.254045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-59876e64-8c43-463e-a553-de95a2c41fb2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.148576 May 13 13:56:44.254617 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 53/103] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:44 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:44.416827 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:44.417562 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:44.424064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.424510 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.425347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.425731 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.490625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.499139 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-50e339ca-0aa3-4cf0-8a21-4b69edff2fc5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1282 microversion: 2.1 time: 0.085814 May 13 13:56:44.499801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 54/104] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:44 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:44.505901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:44.506525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:44.513946 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.514178 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.515515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.516131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.668928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.677409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2381ff52-8594-4fd8-a048-8b6d5a6dfa58 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.176474 May 13 13:56:44.678003 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 55/105] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:44 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:44.754480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:44.755035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:44.761004 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.761463 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.762251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:44.762686 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:44.897979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.906834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.908506 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:44.909699 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-01b007df-be13-439e-b561-3f39be4deb48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.159316 May 13 13:56:44.910261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 56/106] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:44 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:45.121164 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:45.121682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:45.127842 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.128230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.129002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.129435 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.259867 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:45.268102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-438ef934-41fb-402b-8548-171d76706a66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.150803 May 13 13:56:45.268676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 57/107] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:45 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:45.273060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:45.273663 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:45.279536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.279984 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.281440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.281877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.422900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:45.430485 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b1f83fa8-31e1-4d61-a0a6-f7f6339a3439 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.160850 May 13 13:56:45.431091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 58/108] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:45 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:45.517719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:45.518332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:45.524729 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.525183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.525992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.526429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.591704 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:45.599212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2b158a6f-e2fa-4581-904e-442a1cb299ea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1282 microversion: 2.1 time: 0.085873 May 13 13:56:45.599700 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 59/109] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:45 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1282 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:45.695494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:45.696204 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:45.703346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.703895 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:45.704587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:45.705075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:46.216918 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:46.227043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b8022e5c-d287-4c5f-b4df-f98226aff4b7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.535293 May 13 13:56:46.228102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 60/110] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:45 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:46.261338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:46.262030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:46.270752 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:46.271219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:46.272018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:46.273049 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:46.577701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e432650a-43c5-4049-b1a5-8d54434852c6 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "POST /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.121796 May 13 13:56:46.579698 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 51/111] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:56:43 2022] POST /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d/os-volume_attachments => generated 194 bytes in 3125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:46.588614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:46.589595 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:46.597941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:46.598525 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:46.599455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:46.600123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:46.953412 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:46.981022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:46.983976 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:46.986056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5de64f5a-8484-4c0e-95ad-fb654599e46d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.746622 May 13 13:56:46.988563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 61/112] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:46 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:46.995851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-8bd67b56-18df-4e02-9197-d43237f12434 req-1257ecde-039a-4c46-b793-262e2ebf95c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c44ce14-5d23-453e-bfde-1fb8c8d74c2a", "name": "network-vif-plugged", "status": "completed", "tag": "ce3869b7-d2b1-485b-b44b-6654613759f1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:47.011827 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-8bd67b56-18df-4e02-9197-d43237f12434 req-1257ecde-039a-4c46-b793-262e2ebf95c1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.012900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-8bd67b56-18df-4e02-9197-d43237f12434 req-1257ecde-039a-4c46-b793-262e2ebf95c1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.038865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:47.050437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-8bd67b56-18df-4e02-9197-d43237f12434 req-1257ecde-039a-4c46-b793-262e2ebf95c1 service nova] Creating event network-vif-plugged:ce3869b7-d2b1-485b-b44b-6654613759f1 for instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a on hv-cinder-84175 May 13 13:56:47.050736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-258f6e93-710f-4627-a08c-947d7070755a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.466204 May 13 13:56:47.067476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 52/113] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:46 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:47.074443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:47.080461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:47.084927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-8bd67b56-18df-4e02-9197-d43237f12434 req-1257ecde-039a-4c46-b793-262e2ebf95c1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094494 May 13 13:56:47.086064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 62/114] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:47.097411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.098742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:47.099761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:47.101706 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.103593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.105807 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.113694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.120133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.126253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.127290 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.424273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:47.433931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-72188c5a-56e2-4840-82c2-69d1ecb769a1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1280 microversion: 2.1 time: 0.346433 May 13 13:56:47.434909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 63/115] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:47 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1280 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:47.441644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:47.442734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:47.450875 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.451666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.452732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:47.453382 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:47.709056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:47.717599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-439f8f69-33f5-42ff-981c-fe1725d8de82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.648677 May 13 13:56:47.718213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 53/116] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:47 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:47.911053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:47.919198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2ab1908c-fed3-46e7-970f-ea03a2109743 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.482834 May 13 13:56:47.919884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 64/117] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:47 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:48.008446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:48.009060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:48.017722 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.018176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.019009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.020166 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.087790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:48.088293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:48.094278 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.094732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.095548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.095974 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.329894 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:48.359719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:48.368868 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:48.380956 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:48.383398 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-81d5b2b6-6ee5-4fd7-bcb7-144aad7401bc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.377795 May 13 13:56:48.386980 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 54/118] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:48 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:48.387364 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-809d7637-1f78-4432-be3e-d66175a9e1f0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.295089 May 13 13:56:48.389250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 65/119] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:48 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:48.463289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:48.464123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:48.479059 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.480021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.481645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.482311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.738871 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:48.740115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:48.753652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.754480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:48.755509 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:48.756366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.253802 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.262513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-22cda987-7026-40b1-8286-c0a0514fe424 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.805579 May 13 13:56:49.271889 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 55/120] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:48 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:49.277605 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:49.278363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:49.285565 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:49.286387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.287268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:49.287850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.297820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.306321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fd948eb9-8392-43c9-8e8f-26ec2e864ffb tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.575286 May 13 13:56:49.320042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 66/121] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:48 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:49.411495 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:49.414804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:49.423197 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:49.425737 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.429061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:49.446416 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.616285 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.625876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2b311f0a-ce75-4527-a6c6-16bc0c1ee12c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.352438 May 13 13:56:49.626987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 56/122] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:49 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:49.639156 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:49.641070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:49.651291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:49.652378 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.653522 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:49.654063 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:49.713793 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.722583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.724891 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.726093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7c3fff11-0af5-4580-9406-7ad4654e7293 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.324848 May 13 13:56:49.726667 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 67/123] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:49 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:49.874464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:49.888501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6be082ca-66df-4756-b786-242a1ae2977f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.253554 May 13 13:56:49.904451 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 57/124] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:49 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:50.157137 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-d5475879-7e61-48cb-ac67-7212a8a2979a req-f399a87b-a97c-4e35-8e7b-59bdadd87534 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0371ede2-e0ba-463b-b866-27b37ecdd87c", "tag": "b7847ace-539c-49f8-8691-796f0be69992"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:50.168921 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-d5475879-7e61-48cb-ac67-7212a8a2979a req-f399a87b-a97c-4e35-8e7b-59bdadd87534 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.170222 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-d5475879-7e61-48cb-ac67-7212a8a2979a req-f399a87b-a97c-4e35-8e7b-59bdadd87534 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.185332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-d5475879-7e61-48cb-ac67-7212a8a2979a req-f399a87b-a97c-4e35-8e7b-59bdadd87534 service nova] Creating event network-changed:b7847ace-539c-49f8-8691-796f0be69992 for instance 0371ede2-e0ba-463b-b866-27b37ecdd87c on hv-cinder-84175 May 13 13:56:50.200001 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-d5475879-7e61-48cb-ac67-7212a8a2979a req-f399a87b-a97c-4e35-8e7b-59bdadd87534 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045892 May 13 13:56:50.200864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 68/125] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:50.280127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:50.281353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:50.293848 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.294692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.295632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.296499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.331217 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:50.331919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:50.349758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.357053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.358671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.359351 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.558769 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:50.578971 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3bec10ae-0d67-4821-9df3-e625979b6a64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.302819 May 13 13:56:50.593473 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 58/126] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:50 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:50.626639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-6e0e24d4-0478-4355-8bcd-45ec8e759350 req-e6d6e46a-0c54-4162-a8e5-45fb771e5703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fb9024-5080-4527-b9ac-55f60dbccd8a", "name": "network-vif-plugged", "status": "completed", "tag": "504a7fcd-a3fa-4e91-ae56-90416b5e697f"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:50.636201 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-6e0e24d4-0478-4355-8bcd-45ec8e759350 req-e6d6e46a-0c54-4162-a8e5-45fb771e5703 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.637360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-6e0e24d4-0478-4355-8bcd-45ec8e759350 req-e6d6e46a-0c54-4162-a8e5-45fb771e5703 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.652262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-6e0e24d4-0478-4355-8bcd-45ec8e759350 req-e6d6e46a-0c54-4162-a8e5-45fb771e5703 service nova] Creating event network-vif-plugged:504a7fcd-a3fa-4e91-ae56-90416b5e697f for instance c5fb9024-5080-4527-b9ac-55f60dbccd8a on hv-cinder-84175 May 13 13:56:50.664895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-6e0e24d4-0478-4355-8bcd-45ec8e759350 req-e6d6e46a-0c54-4162-a8e5-45fb771e5703 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041412 May 13 13:56:50.666430 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 59/127] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:50.684404 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:50.687383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:50.700586 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.701161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.702679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.703247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.795642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:50.804153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4cb2688e-16df-4f32-a3f6-b5480e6cb83e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.479099 May 13 13:56:50.805865 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 69/128] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:50 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:50.813169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:50.814076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:50.824666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.825569 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.828449 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.829107 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.963300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:50.974991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b29c75f8-a6e1-4ff1-b3e5-b3208c897d8d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.306269 May 13 13:56:50.975606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 60/129] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:50 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:50.983322 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:50.984258 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:50.991992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.992810 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:50.993844 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:50.994486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.034766 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:51.058448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:51.060677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:51.062962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-64f83f24-8f88-4198-bce7-9411937d9d28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.255824 May 13 13:56:51.064155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 70/130] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:50 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:56:51.162668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:51.171007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c90b7a7b-0163-4a24-a259-6fb0d1661788 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.193499 May 13 13:56:51.171692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 61/131] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:50 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:51.600100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:51.600994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:51.607024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.607484 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.608630 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.609294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.762322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:51.794130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cd6d9ed8-1379-4d70-bd93-f46076dd3676 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.196904 May 13 13:56:51.794402 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 71/132] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:51 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:51.829528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:51.830143 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:51.837092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.837876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.838681 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:51.839313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:51.990118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:51.998027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a6f67b35-272a-466c-87a3-f72ec2eb81b8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.174030 May 13 13:56:51.999355 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 62/133] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:51 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:51.999602 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:52.000232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:52.006476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.006967 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.007768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.008206 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.081868 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:52.082816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:52.089112 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.089522 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.090607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.090752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.179347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:52.188719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-32e6735c-5cf1-4a8d-87f4-043dc8609db2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.193326 May 13 13:56:52.197814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 72/134] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:51 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:52.197814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:52.197814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:52.202239 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.202689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.203494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.203927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.268461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:52.276905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:52.278557 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:52.280309 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fdee3e6c-0bdb-4c39-9618-76d88e52e121 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.202578 May 13 13:56:52.281106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 63/135] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:52 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:52.578621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:52.586680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-596a48ec-23f1-4341-ae41-8f99ca2bde24 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.395780 May 13 13:56:52.597299 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 73/136] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:52 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:52.681027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-f4c431e9-6f38-4d4c-b0d2-ef2c2f421a66 req-01844c17-a9b1-4860-82c6-83d3a7f25d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "name": "network-vif-plugged", "status": "completed", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:52.689517 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-f4c431e9-6f38-4d4c-b0d2-ef2c2f421a66 req-01844c17-a9b1-4860-82c6-83d3a7f25d43 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.689957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-f4c431e9-6f38-4d4c-b0d2-ef2c2f421a66 req-01844c17-a9b1-4860-82c6-83d3a7f25d43 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.703018 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-f4c431e9-6f38-4d4c-b0d2-ef2c2f421a66 req-01844c17-a9b1-4860-82c6-83d3a7f25d43 service nova] Creating event network-vif-plugged:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 13:56:52.707889 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-f4c431e9-6f38-4d4c-b0d2-ef2c2f421a66 req-01844c17-a9b1-4860-82c6-83d3a7f25d43 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030586 May 13 13:56:52.708486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 64/137] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:52.811527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:52.812049 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:52.818458 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.818949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.819756 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:52.820193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:52.962575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:52.970546 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1687ca58-1af2-4257-948c-3fb25061e902 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.163474 May 13 13:56:52.971174 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 74/138] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:52 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:53.020599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:53.021398 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:53.028133 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.028699 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.029611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.030939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.186487 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:53.198156 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2d209b43-8db6-4f9d-9a38-1cdb052b8d65 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.182111 May 13 13:56:53.198816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 65/139] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:53 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:53.207071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:53.207868 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:53.217368 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.218163 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.219549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.220275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.300481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:53.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:53.308015 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.308458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.309250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.309692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.644750 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:53.654696 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ef53cedc-9f4e-4864-891d-c9110de64ba9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.452739 May 13 13:56:53.655323 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 75/140] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:53 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:53.660302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:53.660915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:53.661237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:53.667813 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.668258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.669047 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.669483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.671047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:53.672684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:53.673954 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d2532f29-1430-44b1-959e-7d07a4894fb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.377494 May 13 13:56:53.674527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 66/141] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:53 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:53.811856 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:53.819606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-33b62457-cd35-48bc-b203-cbd13b09303c tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.163284 May 13 13:56:53.820407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 76/142] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:53 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:53.987850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:53.988516 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:53.994638 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.995119 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:53.995889 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:53.996322 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.133337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.147332 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-52de08a8-1726-4718-a28b-1d2aa2d7e61b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.162863 May 13 13:56:54.148743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 67/143] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:53 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:54.215823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:54.216516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:54.223499 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.224026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.224930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.225436 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.371794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.383464 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f34f48a6-401c-45c6-a29d-261b6014878a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.171386 May 13 13:56:54.384042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 77/144] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:54 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:54.672454 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:54.672966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:54.679007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.679458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.680232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.680668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.692611 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:54.693223 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:54.699303 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.699756 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.700529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.700967 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.879075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.886562 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.887090 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-feedbe0e-f5c6-463a-a465-c1504b16faa6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.218083 May 13 13:56:54.887199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 68/145] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:54 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:54.891702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:54.892298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:54.895066 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.896674 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:54.897869 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1e37e409-b10d-4f28-8c43-6404b23dd81a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.209213 May 13 13:56:54.898431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 78/146] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:54 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:54.898539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.898989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:54.899679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:54.900102 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.035312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:55.042609 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f5024612-7a44-4ebd-8ea5-acef8828a6b8 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.154443 May 13 13:56:55.043208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 69/147] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:54 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:55.174160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:55.175095 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:55.183361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.183950 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.184863 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.185581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.335384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:55.344656 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-13e5c4b1-88bc-4759-9dda-7ee506788d16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.174357 May 13 13:56:55.345396 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 79/148] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:55 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:55.401903 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:55.402507 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:55.410132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.410592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.411429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.412113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.556549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:55.565772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1c8b07df-48d8-4348-ab1b-9f7f3c88758a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.167608 May 13 13:56:55.566365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 70/149] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:55 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:55.903479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:55.904117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:55.911128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.911571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.912349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.912783 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.916194 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:55.916819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:55.923023 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.923472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:55.924264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:55.924704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.108597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.112130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.116225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-216c5926-d98d-473f-874a-e7087afe671e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.216458 May 13 13:56:56.116882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 80/150] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:55 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:56.121392 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:56.122024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:56.124072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.126951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.129174 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9d9a6735-89d3-4648-9905-d7153ca73afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.216701 May 13 13:56:56.130780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.131435 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.132647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.133359 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.137540 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 71/151] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:55 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:56.270515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.278458 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-010be383-9bf6-4a3a-826a-4b4ffcf01f88 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.160493 May 13 13:56:56.279078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 81/152] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:56 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:56.362966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:56.363583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:56.369480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.369953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.370737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.371178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.509984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.518047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e8051989-e998-46c9-926b-d0523639c61e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.158855 May 13 13:56:56.518627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 72/153] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:56 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:56.583713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:56.584491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:56.590858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.591302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.592131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:56.592559 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:56.731487 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:56.739466 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e8fd8e93-e90d-4111-8eb2-0a6819882860 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.160830 May 13 13:56:56.740253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 82/154] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:56 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:57.133314 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.134266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.141853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.142300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.143132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.143568 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.156975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.157764 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.164083 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.164531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.165326 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.165755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.380589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.390916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.400749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ee4e8679-c8ad-4f77-b639-e3a9b2aff977 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.271205 May 13 13:56:57.401803 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.401984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 73/155] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:57 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:57.405970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.407151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b894148f-9cfc-4273-9851-484545b7f518 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.254837 May 13 13:56:57.407273 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.407708 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 83/156] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:57 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:57.407837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.413927 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.414371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.415186 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.415806 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.536651 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.537950 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.547267 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.547819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.548655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.549109 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.581171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.592642 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-40ba4700-8d4a-4927-8e12-f31aa4bef7bc tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.189704 May 13 13:56:57.597645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 74/157] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:57 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:57.698606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.707289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1ba42381-105c-4d80-823e-234cfe735650 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.174834 May 13 13:56:57.708141 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 84/158] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:57 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:56:57.760664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:57.761775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:57.770039 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.770490 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.771295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:57.771723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:57.912996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:57.923711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e7fcd653-7463-4154-96b3-b652a0d3206b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.170310 May 13 13:56:57.934217 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 75/159] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:57 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:58.421461 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.422088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.428358 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.429567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.429685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.429771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.429983 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.430359 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.439567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.440304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.441759 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.443256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.682590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.687804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.691847 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c7e9d029-d129-459f-98d3-ef46ef9156ca tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.275805 May 13 13:56:58.693233 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 85/160] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:58.698058 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.698659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.706166 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.708558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.708665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.708805 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.709089 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.709518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.709697 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-aa39fae4-16df-4420-8048-177e55d54f92 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.286884 May 13 13:56:58.710563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 76/161] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:58.715477 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-d4220402-e5c3-4dc1-a9ea-dca057af98a4 req-3bef2b43-a8c3-4b50-bfd4-d307cbfb889e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596ea3e4-5857-40b2-82e2-84c63e19f7da", "name": "network-vif-plugged", "status": "completed", "tag": "0cddf8e8-d022-4c17-bc59-86e111fd692f"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:56:58.727924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-d4220402-e5c3-4dc1-a9ea-dca057af98a4 req-3bef2b43-a8c3-4b50-bfd4-d307cbfb889e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.728375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-d4220402-e5c3-4dc1-a9ea-dca057af98a4 req-3bef2b43-a8c3-4b50-bfd4-d307cbfb889e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.740857 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-d4220402-e5c3-4dc1-a9ea-dca057af98a4 req-3bef2b43-a8c3-4b50-bfd4-d307cbfb889e service nova] Creating event network-vif-plugged:0cddf8e8-d022-4c17-bc59-86e111fd692f for instance 596ea3e4-5857-40b2-82e2-84c63e19f7da on hv-cinder-84175 May 13 13:56:58.746185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-d4220402-e5c3-4dc1-a9ea-dca057af98a4 req-3bef2b43-a8c3-4b50-bfd4-d307cbfb889e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034479 May 13 13:56:58.746820 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 77/162] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:56:58.753614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.754393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.760859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.761314 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.762093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.762537 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.926445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.934603 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-84992fe0-fdec-418d-a3d2-481c9bd9edf9 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.239961 May 13 13:56:58.935400 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 86/163] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:58.943111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:58.944060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:58.956207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.956839 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.957733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:58.958407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:58.965532 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:58.976456 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-df55826a-5a12-464b-bbc6-335d81e130c3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.228424 May 13 13:56:58.977044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 78/164] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:59.103822 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.111853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e6c885f3-4592-4616-9235-894cb269b96c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1366 microversion: 2.1 time: 0.172693 May 13 13:56:59.112638 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 87/165] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:58 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:59.709425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:59.710040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:59.716848 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.717364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.718187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.718617 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.731144 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:59.731791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:59.738496 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.739009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.739768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.740390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.927327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.934226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.936844 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2d178bd3-88ec-42e2-9c85-f6ac2ce5d084 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.231171 May 13 13:56:59.938289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 79/166] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:59 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:56:59.953933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.955770 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:56:59.957099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:59.957421 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4bbc4020-8161-4351-8d3b-f092dac9c6cf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.229906 May 13 13:56:59.957828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:56:59.968994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 88/167] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:56:59 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:56:59.981825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.983138 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.984040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:56:59.984627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:56:59.993267 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:56:59.993927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.000095 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.000542 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.001321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.001746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.195228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:00.203214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5c477fec-c258-4791-a671-fa1cc8a82bd1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.253583 May 13 13:57:00.212395 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 80/168] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:59 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:00.212395 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.212395 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.218798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.219250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.220038 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.220546 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.225709 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:00.233442 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6725c5ce-b9ad-4fd6-b488-590fe4f2cfbf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.243883 May 13 13:57:00.233981 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 89/169] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:56:59 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:00.370221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:00.377941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bc0b8303-0e36-43c2-93fa-f4f7c158b211 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1556 microversion: 2.1 time: 0.170752 May 13 13:57:00.378528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 81/170] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:00 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1556 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:00.396899 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.397407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.405689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.406288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.410733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.410733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.551259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e5387492-b977-4565-9fd4-926fcb0d2867 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.155958 May 13 13:57:00.556199 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 90/171] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 13:57:00 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:00.957068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.957717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.964664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.965206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.966053 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.966631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.982338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:00.988864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:00.996440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:00.998085 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:00.999829 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.000530 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:01.802619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:01.810787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-47b51515-c800-4f05-ab3d-aece742bd553 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.859946 May 13 13:57:01.811580 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 82/172] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:00 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:01.823995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:01.823995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:01.828037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:01.831587 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.832747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:01.833016 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.833448 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:01.843889 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:01.845846 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:01.847473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4de65a4f-976a-496c-b2a2-f141d963d161 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.869986 May 13 13:57:01.848295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 91/173] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:57:00 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:01.853473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:01.854215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:01.861837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.862594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:01.863828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:01.864455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.389322 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:02.401457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-83ae5fc2-d06a-4a32-9f5e-e4912b9a08df tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.588789 May 13 13:57:02.402288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 83/174] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:01 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:02.411871 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:02.412642 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:02.425644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.425644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.425644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.425644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.451105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:02.459457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:02.459986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-29153867-8089-4839-8cc8-78a2ee995e68 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.610117 May 13 13:57:02.470165 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 92/175] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:01 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:02.602230 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f3719d2e-f135-432f-b726-360e43d7100c tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 204 len: 0 microversion: 2.1 time: 0.198310 May 13 13:57:02.626975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:02.627605 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:02.630904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 84/176] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 13:57:02 2022] DELETE /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:57:02.638611 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.639129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.640636 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.641328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.701520 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-99677377-dc5a-463a-9e76-21929ef0dd87 req-1ce31d35-5dc2-445f-9973-f8f291258855 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e31b14-12b5-422b-b04a-c37a030d7859", "name": "network-vif-plugged", "status": "completed", "tag": "752c852e-22e0-45b9-a24e-da001a8775e3"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:02.713581 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-99677377-dc5a-463a-9e76-21929ef0dd87 req-1ce31d35-5dc2-445f-9973-f8f291258855 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.714929 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-99677377-dc5a-463a-9e76-21929ef0dd87 req-1ce31d35-5dc2-445f-9973-f8f291258855 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.745032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-99677377-dc5a-463a-9e76-21929ef0dd87 req-1ce31d35-5dc2-445f-9973-f8f291258855 service nova] Creating event network-vif-plugged:752c852e-22e0-45b9-a24e-da001a8775e3 for instance 55e31b14-12b5-422b-b04a-c37a030d7859 on hv-cinder-84175 May 13 13:57:02.761504 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-99677377-dc5a-463a-9e76-21929ef0dd87 req-1ce31d35-5dc2-445f-9973-f8f291258855 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066176 May 13 13:57:02.761993 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 85/177] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:02.840242 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:02.840952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:02.848713 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.849231 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.850026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.850468 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.943664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:02.954221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b2eaaa7d-eb12-4c7b-b550-3241781c708a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.344533 May 13 13:57:02.955452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 93/178] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:02 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:02.960463 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:02.961075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:02.976635 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.977211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:02.978371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:02.979203 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.172161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.205344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4baa5e7e-24f1-4f2d-8f04-4175252ed367 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.376125 May 13 13:57:03.216348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 86/179] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:02 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:03.302702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.313724 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.315872 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.317313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2b883887-ade0-4cc6-84a5-39234d576d0e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1406 microversion: 2.20 time: 0.360699 May 13 13:57:03.318116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 94/180] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:57:02 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1406 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:57:03.386586 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-5e850b74-9178-43a3-86f2-8c06034863e0 req-45f8960e-0bbc-40a5-a85f-3625bc4ee84f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5fb9024-5080-4527-b9ac-55f60dbccd8a", "tag": "504a7fcd-a3fa-4e91-ae56-90416b5e697f"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:03.400825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-5e850b74-9178-43a3-86f2-8c06034863e0 req-45f8960e-0bbc-40a5-a85f-3625bc4ee84f service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.401514 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-5e850b74-9178-43a3-86f2-8c06034863e0 req-45f8960e-0bbc-40a5-a85f-3625bc4ee84f service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.419591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-5e850b74-9178-43a3-86f2-8c06034863e0 req-45f8960e-0bbc-40a5-a85f-3625bc4ee84f service nova] Creating event network-changed:504a7fcd-a3fa-4e91-ae56-90416b5e697f for instance c5fb9024-5080-4527-b9ac-55f60dbccd8a on hv-cinder-84175 May 13 13:57:03.422313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:03.423005 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:03.425495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-5e850b74-9178-43a3-86f2-8c06034863e0 req-45f8960e-0bbc-40a5-a85f-3625bc4ee84f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042575 May 13 13:57:03.426266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 87/181] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:03.432539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.433068 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.433944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.434448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.478140 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:03.479699 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:03.487550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.488006 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.488796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.489234 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.695886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.705436 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-da4d5d50-3376-4334-8c04-f2bf9b031f9d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.289640 May 13 13:57:03.710276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 95/182] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:03 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:03.723611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:03.731816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-89ca22bc-3f74-4ac6-b0a9-d422ee588a13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.258101 May 13 13:57:03.735201 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 88/183] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:03 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:03.971994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:03.972657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:03.981720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.982175 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:03.983868 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:03.984314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.149021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.162553 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e35905c6-cec5-4d31-918a-b2c03bf7f281 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.193902 May 13 13:57:04.163212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 96/184] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:03 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:04.222076 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.223346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.230008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.230592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.231627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.232007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.336942 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.337646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.345180 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.345732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.346599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.347192 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.476612 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.499889 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2f93baf2-bb46-41f6-b652-ebf154e332d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.271988 May 13 13:57:04.500565 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 89/185] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:04.543260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.552033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.553549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:04.554739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b65584a7-d4c0-4bad-9746-94bbd0e8de8b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1599 microversion: 2.20 time: 0.221999 May 13 13:57:04.555311 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 97/186] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1599 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:57:04.574428 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.575299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.582978 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.583440 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.584297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.585150 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.726115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.727515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.735985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.737067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.738787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.739595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.945021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-70221337-2c56-4db7-8f19-5727cb48250b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.374861 May 13 13:57:04.945844 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 90/187] 10.222.0.79 () {60 vars in 1315 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-interface => generated 285 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 13:57:04.957617 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:04.958411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:04.967886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.968343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:04.969420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:04.970212 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.007220 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.015346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9818bd46-ecdb-4dae-891b-b1722ec157d5 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.292986 May 13 13:57:05.017301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 98/188] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:05.181845 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:05.182923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:05.192820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.193273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.194383 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.195082 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.472013 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.483666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.497498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3b48f7c1-1eef-49c1-9b8b-efff382fd252 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.319793 May 13 13:57:05.508585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1403a724-6fa7-4d9c-9002-24992ee53792 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.547104 May 13 13:57:05.508585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 91/189] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:04 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:05.514213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 99/190] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:05 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:05.519531 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:05.520769 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:05.527146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.527647 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.528462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:05.528906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:05.717518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:05.726797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f30102ee-382c-4257-bdd7-5646a799169c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.211397 May 13 13:57:05.727947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 92/191] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:05 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:06.034397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:06.035711 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:06.050003 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.053425 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.057417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.058828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.221012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:06.228754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0f739ee8-1f7d-4649-a55d-206e1c1cdbff tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.198649 May 13 13:57:06.229408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 100/192] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:06 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:06.519710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:06.520521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:06.528701 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:06.529928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:06.533411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.534123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.534976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.535472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.539033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.539596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.540486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.541032 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.754944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:06.760657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:06.777842 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cfd05e59-206c-4b9f-b802-777787ee7a43 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.252464 May 13 13:57:06.778173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dc2831b8-1c5e-4c33-b2ae-5253fc6d0cb8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.262198 May 13 13:57:06.780031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 101/193] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:06 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:06.788343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:06.789407 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 93/194] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:06 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:06.794440 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-6a3b2502-75f3-4c56-8bd3-2ed694771446 req-b1a696ce-5f32-4eb7-9137-6c09b479b946 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:06.800565 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:06.807679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-6a3b2502-75f3-4c56-8bd3-2ed694771446 req-b1a696ce-5f32-4eb7-9137-6c09b479b946 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.809365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-6a3b2502-75f3-4c56-8bd3-2ed694771446 req-b1a696ce-5f32-4eb7-9137-6c09b479b946 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.810985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.811443 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.812862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:06.813310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:06.825350 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-6a3b2502-75f3-4c56-8bd3-2ed694771446 req-b1a696ce-5f32-4eb7-9137-6c09b479b946 service nova] Creating event network-changed:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 13:57:06.831047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-6a3b2502-75f3-4c56-8bd3-2ed694771446 req-b1a696ce-5f32-4eb7-9137-6c09b479b946 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040025 May 13 13:57:06.832081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 94/195] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:07.022316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:07.032117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-db5f5105-0878-4e56-8e35-2c66d220e8e0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1364 microversion: 2.1 time: 0.249920 May 13 13:57:07.033229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 102/196] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:06 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:07.250858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:07.251852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:07.260506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.261241 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.262682 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.264273 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.439639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:07.453107 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fb424c8d-0a90-4c27-b49e-5babce9b1c4f tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.209588 May 13 13:57:07.454182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 95/197] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:07 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:07.795184 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:07.795899 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:07.802202 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.802643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.804021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.804482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.808593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:07.809372 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:07.816032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.816486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:07.817283 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:07.817723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.028916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.032314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.042563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a481079a-a3d4-402c-8186-bbb4f0472163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.238024 May 13 13:57:08.052387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 96/198] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:07 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:08.052556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5066343a-f189-4981-9100-398d17ef1e5e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.254239 May 13 13:57:08.052556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 103/199] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:07 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:08.054658 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:08.055325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:08.064715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.065191 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.066010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.066468 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.250687 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.261820 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1267bfb3-d4b1-4e0d-af08-cb7b15bf0b0f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1550 microversion: 2.1 time: 0.212262 May 13 13:57:08.262570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 97/200] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:08 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1550 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:08.284395 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:08.285099 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:08.295844 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.296279 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.297054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.297518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.379035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9242fac7-63d6-4702-963e-85cc2de866c0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099285 May 13 13:57:08.379743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 104/201] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 13:57:08 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:08.469667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:08.470152 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:08.476215 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.476661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.477446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:08.477873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:08.638491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:08.650958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-00636833-49fc-4847-9bc9-46b7de87561e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.185020 May 13 13:57:08.662414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 98/202] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:08 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:09.061541 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:09.062329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:09.069300 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.069508 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:09.070015 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.070263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:09.071066 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.071709 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.081377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.082064 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.083718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.084353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.350352 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:09.357876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:09.364970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-00de5130-97c4-46ba-8bba-c777f01fb46a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.306285 May 13 13:57:09.366900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 105/203] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:09 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:09.376929 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5230a26e-3747-4658-9bf8-a4146e2f6717 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.304603 May 13 13:57:09.376929 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 99/204] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:09 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:09.672904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:09.673735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:09.676142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-66b3b326-5918-4dc4-8c47-a414eb617a03 req-ffb9db07-ab1a-4e59-b86a-3570572c77be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "596ea3e4-5857-40b2-82e2-84c63e19f7da", "tag": "0cddf8e8-d022-4c17-bc59-86e111fd692f"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:09.686383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.688538 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-66b3b326-5918-4dc4-8c47-a414eb617a03 req-ffb9db07-ab1a-4e59-b86a-3570572c77be service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.689198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-66b3b326-5918-4dc4-8c47-a414eb617a03 req-ffb9db07-ab1a-4e59-b86a-3570572c77be service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.689364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.691154 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:09.692002 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:09.711839 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-66b3b326-5918-4dc4-8c47-a414eb617a03 req-ffb9db07-ab1a-4e59-b86a-3570572c77be service nova] Creating event network-changed:0cddf8e8-d022-4c17-bc59-86e111fd692f for instance 596ea3e4-5857-40b2-82e2-84c63e19f7da on hv-cinder-84175 May 13 13:57:09.719957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-66b3b326-5918-4dc4-8c47-a414eb617a03 req-ffb9db07-ab1a-4e59-b86a-3570572c77be service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049943 May 13 13:57:09.720962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 106/205] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:09.912172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:09.920544 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1d4c71a8-df2d-4938-be94-1c1171513787 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.253822 May 13 13:57:09.921137 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 100/206] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:09 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:10.383642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:10.384498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:10.392033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.392627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.393528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.394057 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.394190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:10.395276 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:10.413040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.413040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.413730 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.414168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.647354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:10.650333 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:10.666910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-69e5f44c-e900-4082-bf15-282a6274ef8a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.285969 May 13 13:57:10.668497 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7c056f62-3b12-4be3-9ee3-22a54761467b tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.277822 May 13 13:57:10.679243 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 107/207] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:10 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:10.682076 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 101/208] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:10 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:10.937828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:10.938576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:10.944718 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.945165 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:10.945949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:10.946452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.092676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.100303 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fa065b46-e87b-4f44-b792-ba7f1765d46b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.166314 May 13 13:57:11.100939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 108/209] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:10 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:11.685785 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:11.687260 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:11.689792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:11.691397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:11.695611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.695980 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.696679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.696909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.697243 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.697412 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.698151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:11.698585 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:11.912037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.914092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:11.922539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dd1a1959-626d-4ab8-9171-57d1aae8f06e tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.237486 May 13 13:57:11.923264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 109/210] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:11 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:11.924892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7093afba-93a4-4f56-bfca-730971e272a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.243368 May 13 13:57:11.925478 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 102/211] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:11 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:12.117658 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:12.118293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:12.125394 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.125874 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.126697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.127171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.267226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:12.274818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ec454946-9f09-47bb-809a-14f767fb829a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.161152 May 13 13:57:12.275399 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 110/212] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:12 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:12.768358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-c92cadfe-943b-4e06-bfc7-ecf72dfbce66 req-a9fe6c0c-cacf-4306-aa04-ad6b4e49594b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d8a733-ab35-4501-9946-8035d5af171d", "name": "network-vif-unplugged", "status": "completed", "tag": "d7ba6f79-08c4-491c-92f8-2ea6a96ad92b"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:12.781241 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-c92cadfe-943b-4e06-bfc7-ecf72dfbce66 req-a9fe6c0c-cacf-4306-aa04-ad6b4e49594b service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.782091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-c92cadfe-943b-4e06-bfc7-ecf72dfbce66 req-a9fe6c0c-cacf-4306-aa04-ad6b4e49594b service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.797180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-c92cadfe-943b-4e06-bfc7-ecf72dfbce66 req-a9fe6c0c-cacf-4306-aa04-ad6b4e49594b service nova] Creating event network-vif-unplugged:d7ba6f79-08c4-491c-92f8-2ea6a96ad92b for instance e9d8a733-ab35-4501-9946-8035d5af171d on hv-cinder-84175 May 13 13:57:12.804058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-c92cadfe-943b-4e06-bfc7-ecf72dfbce66 req-a9fe6c0c-cacf-4306-aa04-ad6b4e49594b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041369 May 13 13:57:12.805009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 103/213] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:12.941411 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:12.942743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:12.947155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:12.948026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:12.949626 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.950235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.951973 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.952692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.956964 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.957672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:12.958723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:12.959389 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:13.228232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.235913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.237213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f36dadf5-e6b9-47cd-9ad5-dfc62b703065 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.299755 May 13 13:57:13.237994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 111/214] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:12 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:13.243532 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-76141346-b271-4f4f-a48c-eeacd7d06dbd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.303417 May 13 13:57:13.244528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 104/215] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:12 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:13.291187 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:13.291786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:13.298993 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:13.299445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:13.300231 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:13.300665 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:13.460831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:13.472816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-53a3ad20-d2d8-49ed-8b37-4ad1bc21d150 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.183775 May 13 13:57:13.473614 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 112/216] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:13 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:14.254414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:14.255068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:14.260451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:14.261096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:14.261199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.261606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.262386 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.262862 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.267047 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.267495 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.268274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.268703 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.457688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.460972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.466009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ccec0088-ee27-4c41-8378-bd6cd6cc5f10 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.215607 May 13 13:57:14.467376 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 105/217] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:14 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:14.469376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fdd1e7e8-22e5-44c5-9c75-d4b368c0b0c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.212679 May 13 13:57:14.470426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 113/218] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:14 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:14.492689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:14.493293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:14.499609 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.500233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.500819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:14.501284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:14.633172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:14.642014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-826acf64-6b12-4b8b-b84d-68f2d85f0126 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.153087 May 13 13:57:14.642610 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 106/219] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:14 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:15.487732 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:15.488277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:15.488622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:15.488699 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:15.495338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.495830 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.496623 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.497075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.503365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.503820 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.505144 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.505974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.709930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:15.713795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:15.718727 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-024a5af1-1dfa-4f5c-b553-65b7fe584cdf tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.237774 May 13 13:57:15.719324 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 114/220] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:15 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:15.723670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-84c35f7b-6dec-4e10-9f4f-9040a57b4bde tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.240018 May 13 13:57:15.724086 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:15.724608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 107/221] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:15 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:15.725437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:15.733113 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.733564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.734354 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:15.734814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:15.869334 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:15.876673 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7d4e3e64-573e-43f9-8db9-a752c5156116 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1314 microversion: 2.1 time: 0.156331 May 13 13:57:15.877235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 115/222] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:15 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:16.741120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:16.742702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:16.743705 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:16.744819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:16.752347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.752949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.753624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.754369 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.754849 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.755477 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:16.755668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:16.756272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.099297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.111968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.114835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a5c70317-498b-4bc1-9325-0247d9b3fcd2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1554 microversion: 2.1 time: 0.380095 May 13 13:57:17.116123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 108/223] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:16 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1554 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:17.120445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6fee9d61-f474-440f-a6d7-9606a617863f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.383227 May 13 13:57:17.121745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 116/224] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:16 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:17.128611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:17.129241 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:17.135536 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.135996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.136805 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.137253 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.307118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-36804d68-554d-4d32-9fef-dcd47a304ed9 req-22c313cf-4d8c-49b7-a04c-1d9f3bab1ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9d8a733-ab35-4501-9946-8035d5af171d", "name": "network-vif-deleted", "tag": "d7ba6f79-08c4-491c-92f8-2ea6a96ad92b"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:17.310154 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:17.316948 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-36804d68-554d-4d32-9fef-dcd47a304ed9 req-22c313cf-4d8c-49b7-a04c-1d9f3bab1ba5 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:17.317491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-36804d68-554d-4d32-9fef-dcd47a304ed9 req-22c313cf-4d8c-49b7-a04c-1d9f3bab1ba5 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:17.318281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-420dce35-6dc8-4db7-8da8-107c65cf7c28 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1497 microversion: 2.1 time: 0.200453 May 13 13:57:17.322702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 109/225] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:17 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1497 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:17.330824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-36804d68-554d-4d32-9fef-dcd47a304ed9 req-22c313cf-4d8c-49b7-a04c-1d9f3bab1ba5 service nova] Creating event network-vif-deleted:d7ba6f79-08c4-491c-92f8-2ea6a96ad92b for instance e9d8a733-ab35-4501-9946-8035d5af171d on hv-cinder-84175 May 13 13:57:17.336665 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-36804d68-554d-4d32-9fef-dcd47a304ed9 req-22c313cf-4d8c-49b7-a04c-1d9f3bab1ba5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033908 May 13 13:57:17.337415 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 117/226] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:18.148453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:18.149487 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:18.150886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:18.152665 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:18.166327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.166909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.167753 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.168229 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.174208 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.174677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.175559 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.176014 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.269598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:18.278244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7cc2a500-b43d-4f6a-ae3d-3bf4da743b32 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1345 microversion: 2.1 time: 0.149525 May 13 13:57:18.279510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 110/227] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:18 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:18.362767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:18.374537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-220046ab-9513-4e9a-9e57-20b3574877a8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.239999 May 13 13:57:18.375528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 118/228] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:18 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:18.561638 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:18.562139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:18.568176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.568631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.569414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.569858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.604718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:18.696251 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fe32f205-31fb-4e98-9ed7-8c1c90f9ae66 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "DELETE /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 204 len: 0 microversion: 2.1 time: 0.138163 May 13 13:57:18.698817 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 111/229] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 13:57:18 2022] DELETE /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:57:18.711386 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:18.711740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:18.723792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.726739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.728167 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:18.728931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:18.875587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:18.883232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-17d371fb-5abc-455a-9826-69850f8ea17b tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1503 microversion: 2.1 time: 0.180882 May 13 13:57:18.884028 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 119/230] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:18 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:19.067087 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-9a6d2d8c-487a-494f-b68b-de3ca3bb4100 req-719b14c0-55fa-4487-9f71-d13388b2e534 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0371ede2-e0ba-463b-b866-27b37ecdd87c", "name": "network-vif-plugged", "status": "completed", "tag": "b7847ace-539c-49f8-8691-796f0be69992"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:19.076442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9a6d2d8c-487a-494f-b68b-de3ca3bb4100 req-719b14c0-55fa-4487-9f71-d13388b2e534 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.076952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9a6d2d8c-487a-494f-b68b-de3ca3bb4100 req-719b14c0-55fa-4487-9f71-d13388b2e534 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.089402 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-9a6d2d8c-487a-494f-b68b-de3ca3bb4100 req-719b14c0-55fa-4487-9f71-d13388b2e534 service nova] Creating event network-vif-plugged:b7847ace-539c-49f8-8691-796f0be69992 for instance 0371ede2-e0ba-463b-b866-27b37ecdd87c on hv-cinder-84175 May 13 13:57:19.095307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-9a6d2d8c-487a-494f-b68b-de3ca3bb4100 req-719b14c0-55fa-4487-9f71-d13388b2e534 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032526 May 13 13:57:19.095920 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 112/231] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:19.296583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:19.297273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:19.303918 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.304363 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.305149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.305583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.392485 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:19.393333 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:19.394160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:19.400578 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.400879 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-31e82e06-1979-40b9-81cd-cc18944bf691 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1345 microversion: 2.1 time: 0.108072 May 13 13:57:19.401231 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.401740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 120/232] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:19 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1345 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:19.405859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.407487 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.563888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:19.572055 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cfaf91da-3760-497f-89a7-d1fbe1974439 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.184077 May 13 13:57:19.572923 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 113/233] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:19 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:19.902233 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:19.902914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:19.909508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.909883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:19.910681 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:19.911159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.053928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:20.062552 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-44b6449c-f310-4b64-831b-00c48fefd47a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1503 microversion: 2.1 time: 0.164489 May 13 13:57:20.063163 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 121/234] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:19 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:20.417634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:20.418259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:20.425512 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:20.425961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.426785 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:20.427228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.499665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0622aea8005b4b82bcb921089974775d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd42ea16d0ee64f398b01b206c1960b08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:20.507748 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-749e468b-9c21-4995-aaa0-61c202ca89d2 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 200 len: 1345 microversion: 2.1 time: 0.094151 May 13 13:57:20.508304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 114/235] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:20 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 1345 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:20.593461 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:20.595042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:20.604322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:20.604781 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.605582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:20.606022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:20.760396 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:20.769103 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c6f28981-5d7c-4b1f-9c2e-d5c15ce6b6af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.180223 May 13 13:57:20.769720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 122/236] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:20 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:21.081005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:21.081906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:21.087912 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.088366 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.089153 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.089595 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.257521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:21.268732 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-73686099-9691-48cc-8f38-7973bc106e4e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1503 microversion: 2.1 time: 0.192167 May 13 13:57:21.269566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 115/237] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:21 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:21.526324 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:21.527455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:21.547359 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.548502 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.554677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.554677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.576038 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] HTTP exception thrown: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Request method failure captured: May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d HTTP/1.1 May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNlSc1ZMuJ1_2iVNratW-Dqv235uTtG_XibSMcKH1JTZOiUdraWh7cqGO_3War6rLx-m3NVuhkAr4JY669rDezFDOHxIDUoRp-C9BbKm6ujxpz8ERNJ6_RJsUKnTbsSXdXlXbGPCr_4clCkdmqP6remLRMdOMrnQWvE7HFAGye3PaU May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:57:21.581009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 0622aea8005b4b82bcb921089974775d May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.582431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'e9d8a733-ab35-4501-9946-8035d5af171d'} May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:21.583193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.584321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:21.585398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Returning 404 to user: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:21.585398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-def5fd2e-8389-4e60-a8eb-e0f0702dc13a tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 404 len: 111 microversion: 2.1 time: 0.060874 May 13 13:57:21.585398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 123/238] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:21 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:21.755779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:21.757433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:21.769622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.770375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.771825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.772570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.788594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:21.790150 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:21.802391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] HTTP exception thrown: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.808364 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.808836 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.810149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:21.810586 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Request method failure captured: May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d/os-volume_attachments HTTP/1.1 May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNlSc1ZMuJ1_2iVNratW-Dqv235uTtG_XibSMcKH1JTZOiUdraWh7cqGO_3War6rLx-m3NVuhkAr4JY669rDezFDOHxIDUoRp-C9BbKm6ujxpz8ERNJ6_RJsUKnTbsSXdXlXbGPCr_4clCkdmqP6remLRMdOMrnQWvE7HFAGye3PaU May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:57:21.817674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 0622aea8005b4b82bcb921089974775d May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.819172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'server_id': 'e9d8a733-ab35-4501-9946-8035d5af171d'} May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:21.819962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:21.821269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:21.824054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Returning 404 to user: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:21.825299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8a52a045-2806-423c-9ac0-77c9641a8866 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.077876 May 13 13:57:21.830292 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 116/239] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 13:57:21 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d/os-volume_attachments => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:22.038702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:22.057753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c89de3fa-cb05-430d-89a2-a0370a050bd4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.273997 May 13 13:57:22.058764 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 124/240] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:21 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:22.174356 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-c2b8eabf-63c2-4d43-b718-4e137db3166e req-ae88877e-5a26-43bb-b73e-29af5cea64e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55e31b14-12b5-422b-b04a-c37a030d7859", "name": "network-vif-deleted", "tag": "752c852e-22e0-45b9-a24e-da001a8775e3"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:22.191825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-c2b8eabf-63c2-4d43-b718-4e137db3166e req-ae88877e-5a26-43bb-b73e-29af5cea64e3 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:22.192274 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-c2b8eabf-63c2-4d43-b718-4e137db3166e req-ae88877e-5a26-43bb-b73e-29af5cea64e3 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:22.205818 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-c2b8eabf-63c2-4d43-b718-4e137db3166e req-ae88877e-5a26-43bb-b73e-29af5cea64e3 service nova] Creating event network-vif-deleted:752c852e-22e0-45b9-a24e-da001a8775e3 for instance 55e31b14-12b5-422b-b04a-c37a030d7859 on hv-cinder-84175 May 13 13:57:22.212311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-c2b8eabf-63c2-4d43-b718-4e137db3166e req-ae88877e-5a26-43bb-b73e-29af5cea64e3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042251 May 13 13:57:22.213129 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 117/241] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:22.285914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:22.286442 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:22.293177 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:22.293720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:22.295221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:22.295711 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:22.541570 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:22.562762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c1c48aad-d4e5-4f3e-9f7d-e29839f88c1a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1461 microversion: 2.1 time: 0.280466 May 13 13:57:22.564082 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 125/242] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:22 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1461 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:23.083217 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:23.083925 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:23.091254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.092167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.093286 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.093935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.284424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:23.292812 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-095d63c3-40b4-4ef7-8701-d430ba8151bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.214303 May 13 13:57:23.293419 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 118/243] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:23 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:23.582121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:23.582672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:23.589311 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.589766 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.590628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:23.591918 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:23.835438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:23.846728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f099093c-5f4c-4196-b16a-2b45cc19f423 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1461 microversion: 2.1 time: 0.268484 May 13 13:57:23.847516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 126/244] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:23 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1461 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:24.313023 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:24.314205 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:24.325252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.326068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:24.327646 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.328218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:24.526743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:24.537717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f2ae711f-46ef-4eaa-a3ac-332d4c399a24 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.230788 May 13 13:57:24.538944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 119/245] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:24 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:24.876378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:24.877114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:24.883364 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.883807 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:24.884607 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.885038 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:24.934812 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:24.935828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:24.936613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lazy-loading 'fault' on Instance uuid 55e31b14-12b5-422b-b04a-c37a030d7859 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:24.995492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:25.008898 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8bbdb5f3-8805-434b-b0bf-4f5504d145c1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1304 microversion: 2.1 time: 0.136325 May 13 13:57:25.009558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 127/246] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:24 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1304 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:25.560719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:25.561783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:25.577272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:25.577900 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:25.579152 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:25.579815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:25.792890 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:25.801976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-295e232b-57f1-4b5d-abea-c2b29a27cc18 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1322 microversion: 2.1 time: 0.248292 May 13 13:57:25.802878 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 120/247] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:25 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:26.033273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:26.034316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:26.042754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.043491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.045142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.045582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.101155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.101684 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.102389 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lazy-loading 'fault' on Instance uuid 55e31b14-12b5-422b-b04a-c37a030d7859 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:26.156565 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:26.167957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1f944134-c4cb-4b0c-aa1b-70ec14a3215e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 200 len: 1304 microversion: 2.1 time: 0.140597 May 13 13:57:26.168565 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 128/248] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:26 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 1304 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:26.279170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:26.280264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:26.290758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.290758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.290758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.290758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.308796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] HTTP exception thrown: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Request method failure captured: May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d HTTP/1.1 May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNlSc1ZMuJ1_2iVNratW-Dqv235uTtG_XibSMcKH1JTZOiUdraWh7cqGO_3War6rLx-m3NVuhkAr4JY669rDezFDOHxIDUoRp-C9BbKm6ujxpz8ERNJ6_RJsUKnTbsSXdXlXbGPCr_4clCkdmqP6remLRMdOMrnQWvE7HFAGye3PaU May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:57:26.311825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 0622aea8005b4b82bcb921089974775d May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.313665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'e9d8a733-ab35-4501-9946-8035d5af171d'} May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:26.315527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.322976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:26.326510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Returning 404 to user: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:26.326510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e9425a7d-eaea-46f2-9d5e-ffef794dc0cb tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 404 len: 111 microversion: 2.1 time: 0.040207 May 13 13:57:26.326510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 121/249] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 13:57:26 2022] DELETE /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:26.332706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:26.333532 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] [instance: e9d8a733-ab35-4501-9946-8035d5af171d] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:26.342938 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.343719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.344570 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.344940 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.360054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] HTTP exception thrown: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Request method failure captured: May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d HTTP/1.1 May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNlSc1ZMuJ1_2iVNratW-Dqv235uTtG_XibSMcKH1JTZOiUdraWh7cqGO_3War6rLx-m3NVuhkAr4JY669rDezFDOHxIDUoRp-C9BbKm6ujxpz8ERNJ6_RJsUKnTbsSXdXlXbGPCr_4clCkdmqP6remLRMdOMrnQWvE7HFAGye3PaU May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:57:26.361819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_d42ea16d0ee64f398b01b206c1960b08"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: d42ea16d0ee64f398b01b206c1960b08 May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-DeleteServersTestJSON-1793605387 May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 0622aea8005b4b82bcb921089974775d May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-DeleteServersTestJSON-1793605387-project May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.365215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'e9d8a733-ab35-4501-9946-8035d5af171d'} May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:26.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. May 13 13:57:26.369140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:26.372969 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] Returning 404 to user: Instance e9d8a733-ab35-4501-9946-8035d5af171d could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:26.372969 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bf2b5917-8ddd-4461-8f5c-8c2af4428360 tempest-DeleteServersTestJSON-1793605387 tempest-DeleteServersTestJSON-1793605387-project] 10.222.0.79 "GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d" status: 404 len: 111 microversion: 2.1 time: 0.042094 May 13 13:57:26.372969 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 129/250] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:26 2022] GET /compute/v2.1/servers/e9d8a733-ab35-4501-9946-8035d5af171d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:26.820148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:26.821515 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:26.828982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.829435 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:26.830466 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:26.831457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.127759 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:27.137215 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2a020b8f-8c91-4605-8ff3-d43ed4adb881 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1517 microversion: 2.1 time: 0.320914 May 13 13:57:27.138953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 122/251] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:26 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1517 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:27.157569 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:27.159056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:27.166003 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.166813 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.167880 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.168349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.188442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:27.189764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 55e31b14-12b5-422b-b04a-c37a030d7859] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:27.198229 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.198983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.200707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.201341 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.201824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'flavor' on Instance uuid 0371ede2-e0ba-463b-b866-27b37ecdd87c {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:57:27.232784 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] HTTP exception thrown: Instance 55e31b14-12b5-422b-b04a-c37a030d7859 could not be found. May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Request method failure captured: May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 HTTP/1.1 May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOIY73FIzbZIP6koNbSJln1kJ0JIbsCZR55JvPCtng17s86wXBcsaJRzpwR8186GKbiwKKjkDAkO5PkFvkieYNe6hWSO8s_UXaxV7ab1AKX_lS8eUt6VVZzijXdfdDqv2-oBe_G9jHLMHDGN2EYU8ouYotWaowhoB49wgejym0ZEgs May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 703aa4774820401da920e420eb6181d9 May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesActionsTest-480609634 May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:57:27.236161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/703aa4774820401da920e420eb6181d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/703aa4774820401da920e420eb6181d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/703aa4774820401da920e420eb6181d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_703aa4774820401da920e420eb6181d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesActionsTest-480609634 May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 703aa4774820401da920e420eb6181d9 May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesActionsTest-480609634 May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesActionsTest-480609634-project May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 8ef0eaa76ffe4b62a132f0f4ee595a6f May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesActionsTest-480609634-project May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 55e31b14-12b5-422b-b04a-c37a030d7859 could not be found. May 13 13:57:27.238368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '55e31b14-12b5-422b-b04a-c37a030d7859'} May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55e31b14-12b5-422b-b04a-c37a030d7859 could not be found. May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:27.239564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55e31b14-12b5-422b-b04a-c37a030d7859 could not be found. May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55e31b14-12b5-422b-b04a-c37a030d7859 could not be found. May 13 13:57:27.241498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:57:27.248948 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Returning 404 to user: Instance 55e31b14-12b5-422b-b04a-c37a030d7859 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:27.248948 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d28b9f62-ce1f-4a9c-8f8f-15465a0adaf1 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859" status: 404 len: 111 microversion: 2.1 time: 0.054383 May 13 13:57:27.248948 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 123/252] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:27 2022] GET /compute/v2.1/servers/55e31b14-12b5-422b-b04a-c37a030d7859 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:27.385219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1d577473-dece-4cf4-b724-28909fca6cd7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c/action" status: 200 len: 32 microversion: 2.1 time: 0.233240 May 13 13:57:27.391597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 130/253] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 13:57:27 2022] POST /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:57:27.396690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:27.397374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:27.405699 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.406843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.408031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:27.408806 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:27.470461 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-476190276", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "networks": [{"uuid": "fa0dc286-b2aa-44ba-a34e-5eec53911313"}]}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:27.547382 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] validate_networks() for [('fa0dc286-b2aa-44ba-a34e-5eec53911313', None, None, None, None, None)] {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:57:27.734960 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:27.760837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a747f13f-93a0-4204-af22-7edd23bd9539 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.368714 May 13 13:57:27.763982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 124/254] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:27 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:28.312208 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:57:28.313018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:57:28.313888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:57:28.314816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:57:28.315957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:57:28.332514 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:28.333260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:28.334642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:28.335541 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:28.399914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Getting quotas for project 703aa4774820401da920e420eb6181d9. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:28.408407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Getting quotas for user 8ef0eaa76ffe4b62a132f0f4ee595a6f and project 703aa4774820401da920e420eb6181d9. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:28.426631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:57:28.429448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:57:28.487214 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-06ffbc85-67e4-4db3-abed-6d881ce4ebe0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.021868 May 13 13:57:28.490754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 131/255] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:57:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:57:28.499390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-15dea2c2-f782-4945-a7a2-43e2ef82cbee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:28.500747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-15dea2c2-f782-4945-a7a2-43e2ef82cbee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:28.605245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-15dea2c2-f782-4945-a7a2-43e2ef82cbee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:28.616207 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-15dea2c2-f782-4945-a7a2-43e2ef82cbee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1213 microversion: 2.1 time: 0.121474 May 13 13:57:28.626447 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 125/256] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:28 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1213 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:28.787415 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:28.788458 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:28.803776 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:28.807417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:28.808649 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:28.811229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:29.023873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:29.032623 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3951cc64-067a-488b-a0c8-976adb58bdcc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.255977 May 13 13:57:29.033525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 132/257] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:28 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:29.640193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:29.641143 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:29.649058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:29.649507 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:29.650494 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:29.651111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:29.730450 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:29.739741 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-30e47011-3ea8-4b24-bbc7-778caf6efed3 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1265 microversion: 2.1 time: 0.107397 May 13 13:57:29.740439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 126/258] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:29 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1265 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:30.072853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:30.077465 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:30.102325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:30.104251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:30.106701 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:30.108826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:30.333821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:30.346286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-578329c6-2b8b-4cf8-b547-e2f2a178f5d3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.297158 May 13 13:57:30.347826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 133/259] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:30 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:30.770369 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:30.772408 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:30.795756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:30.801725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:30.803244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:30.804198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:30.898997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-adf49ff2-809a-4520-8efa-49202a79ba10 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3bdf44700>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:30.976865 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-adf49ff2-809a-4520-8efa-49202a79ba10 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/e1b56ce8-8b19-4c12-a0d8-7fddbf76a202" status: 200 len: 350 microversion: 2.1 time: 0.082588 May 13 13:57:30.977454 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 134/260] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 13:57:30 2022] GET /compute/v2.1/os-volumes/e1b56ce8-8b19-4c12-a0d8-7fddbf76a202 => generated 350 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:31.147249 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:31.169546 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-43e1ea2a-81ad-40bd-ad4b-5713208f70d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.404238 May 13 13:57:31.171319 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 127/261] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:30 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:31.365339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:31.366116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:31.379719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:31.380561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:31.381642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:31.382292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:31.583092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:31.593597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-79c55bcd-24b7-4589-a6d8-5747d8d61afa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.232366 May 13 13:57:31.595250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 135/262] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:31 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:32.190838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-10e08598-f5dc-41a0-9fc2-a53b23181214 req-b2d329d5-02df-4740-a945-c242e1f0dbee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b4da520-c7a6-46c2-905f-6ebe28df0fda", "tag": "3affb7e8-3e00-4de2-bf21-04a103f2d90e"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:32.201098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:32.209437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:32.211365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-10e08598-f5dc-41a0-9fc2-a53b23181214 req-b2d329d5-02df-4740-a945-c242e1f0dbee service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.212717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-10e08598-f5dc-41a0-9fc2-a53b23181214 req-b2d329d5-02df-4740-a945-c242e1f0dbee service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.229814 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-10e08598-f5dc-41a0-9fc2-a53b23181214 req-b2d329d5-02df-4740-a945-c242e1f0dbee service nova] Creating event network-changed:3affb7e8-3e00-4de2-bf21-04a103f2d90e for instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda on hv-cinder-84175 May 13 13:57:32.239493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-10e08598-f5dc-41a0-9fc2-a53b23181214 req-b2d329d5-02df-4740-a945-c242e1f0dbee service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061735 May 13 13:57:32.241273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.241872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 128/263] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:32.248575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.251888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.252655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.458983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0ca1d50a-9f0b-4a83-a6f7-f9ff5084c27a tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3be66eb80>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:32.557948 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0ca1d50a-9f0b-4a83-a6f7-f9ff5084c27a tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/5250317b-9c07-47d8-a237-64c9cca22b4e" status: 200 len: 350 microversion: 2.1 time: 0.104837 May 13 13:57:32.558169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:32.558777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 129/264] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 13:57:32 2022] GET /compute/v2.1/os-volumes/5250317b-9c07-47d8-a237-64c9cca22b4e => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:32.571857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6ce92629-61c3-409a-83ad-48220ed9c1dd tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.385614 May 13 13:57:32.589002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 136/265] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:32 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:32.621198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:32.623584 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:32.637781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.639340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.640627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:32.641646 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:32.952183 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:32.966676 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-67cf27d3-f884-4910-bae7-cfade4244a4b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.352902 May 13 13:57:32.968218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 130/266] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:32 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:33.594737 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:33.596009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:33.608132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.609456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.610913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:33.611674 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:33.864555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:33.892234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-332053b7-a74f-4598-a831-0228e46c8c5a tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.303877 May 13 13:57:33.893321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 137/267] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:33 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:33.995723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:33.997467 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:34.008078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.008873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.009910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.010367 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.221061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-485ec385-5af7-424f-8f7a-4631a99e5a08 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3bdea8040>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.312657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-485ec385-5af7-424f-8f7a-4631a99e5a08 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/2a67853c-6598-4bf4-9383-cc6178bd017f" status: 200 len: 351 microversion: 2.1 time: 0.101127 May 13 13:57:34.314482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 138/268] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/os-volumes/2a67853c-6598-4bf4-9383-cc6178bd017f => generated 351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:34.336915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4af03cb6-076c-4561-b3b3-f91a7feb72d3 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3c0d6dd30>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.349526 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:34.361869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3aa4f8a9-5d1e-402d-b5fc-fd0cb9a75a16 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.376893 May 13 13:57:34.363770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 131/269] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:33 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:34.476718 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4af03cb6-076c-4561-b3b3-f91a7feb72d3 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.148555 May 13 13:57:34.477712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 139/270] 10.222.0.79 () {58 vars in 1133 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:34.502875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6bb9ff93-05be-40ad-84f4-86ada22f3dd3 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3be77c430>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.624082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6bb9ff93-05be-40ad-84f4-86ada22f3dd3 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.130537 May 13 13:57:34.625383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 132/271] 10.222.0.79 () {58 vars in 1148 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:34.649009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5d8b7d03-d619-40f4-a095-cb291977d79e tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3bdf0f0d0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.788012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5d8b7d03-d619-40f4-a095-cb291977d79e tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.147427 May 13 13:57:34.788962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 140/272] 10.222.0.79 () {58 vars in 1133 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:34.801670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b66f9412-85c5-4b51-9c7b-e4ca9b1daf8f tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3be7f2e50>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.921269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:34.922394 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:34.952965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.957614 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.959808 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:34.961498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:34.995187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b66f9412-85c5-4b51-9c7b-e4ca9b1daf8f tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.197064 May 13 13:57:34.997240 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 133/273] 10.222.0.79 () {58 vars in 1166 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:35.028735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-65c316e7-9250-4935-9bbc-c4f5865a146f tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3bf147280>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.162614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-65c316e7-9250-4935-9bbc-c4f5865a146f tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.150073 May 13 13:57:35.163339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 134/274] 10.222.0.79 () {58 vars in 1169 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:35.197979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4f4f3361-cb5a-4c0a-b8fd-c248f1f4231e tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3be66e940>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.343788 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:35.362276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-46f4bce0-d3b6-428f-bd56-c8522b11c2ee tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.451985 May 13 13:57:35.364336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 141/275] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:34 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:35.393893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.398668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:35.426168 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:35.427012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:35.437046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:35.437719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:35.445081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4f4f3361-cb5a-4c0a-b8fd-c248f1f4231e tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.258622 May 13 13:57:35.446209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 135/276] 10.222.0.79 () {58 vars in 1154 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:35.466879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-12e22e1e-8f25-478c-bd0d-463900153a2b tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3be77c670>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.788299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-12e22e1e-8f25-478c-bd0d-463900153a2b tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.327965 May 13 13:57:35.803127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 136/277] 10.222.0.79 () {58 vars in 1187 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:35.808673 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:35.811733 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6bbe289c-3c1e-4cd7-8cf8-f6ef16be98e7 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] Calling method '.version_select at 0x7fb3be6ac820>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:35.826899 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-239440c4-bc52-4750-8ec2-8a2a45bc53fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.440265 May 13 13:57:35.841472 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 142/278] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:35.982001 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6bbe289c-3c1e-4cd7-8cf8-f6ef16be98e7 tempest-VolumesTestJSON-713968521 tempest-VolumesTestJSON-713968521-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.176434 May 13 13:57:35.987692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 137/279] 10.222.0.79 () {58 vars in 1154 bytes} [Fri May 13 13:57:35 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:36.382328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:36.382979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:36.391312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.392088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.393223 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.393966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.653850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:36.667995 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a91fa3dd-6e14-499a-a24e-86ef3c01d999 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.289394 May 13 13:57:36.669083 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 143/280] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:36 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:36.859196 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:36.860853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:36.867736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.868359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:36.869214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:36.869638 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:37.100578 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:37.118642 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-02665c5c-ad88-413b-9ef7-9048bba389d1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.265197 May 13 13:57:37.138893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 138/281] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:36 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:37.694753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:37.696148 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:37.706174 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:37.707133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:37.708155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:37.708992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:37.757056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-467831833", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "networks": [{"uuid": "5b41b3ab-3663-47b0-839d-04d5811870fd"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:37.850010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] validate_networks() for [('5b41b3ab-3663-47b0-839d-04d5811870fd', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:57:38.098229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:38.106061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a876f189-fef8-4f24-b121-36914cd8c961 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.415430 May 13 13:57:38.106906 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 144/282] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:37 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:38.157708 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:38.158473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:38.168459 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:38.169214 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.170567 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:38.171410 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.506332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:38.517276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-26ef587a-316e-4791-8bb1-bc2c16761b1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.374102 May 13 13:57:38.518413 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 145/283] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:38 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:38.679947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:57:38.680807 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:57:38.681282 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:57:38.681535 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:57:38.681941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:57:38.694014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:38.694830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.696248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:38.696991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:38.722362 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Getting quotas for project a6843d24fbf2449cbd117b8d9cfc7072. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:57:38.728152 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Getting quotas for user 902bea79f26a4c1d8c3c1937f99f9d4b and project a6843d24fbf2449cbd117b8d9cfc7072. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:57:38.743021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:57:38.745577 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:57:38.809265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f6ac9f31-8599-4401-aa48-f0d0addbf78c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056652 May 13 13:57:38.810252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 139/284] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:57:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:57:38.826841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7268b13f-5e7a-4424-aacb-b361df0d10ea tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:38.828331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7268b13f-5e7a-4424-aacb-b361df0d10ea tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:38.914657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7268b13f-5e7a-4424-aacb-b361df0d10ea tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:38.924739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7268b13f-5e7a-4424-aacb-b361df0d10ea tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1218 microversion: 2.1 time: 0.103089 May 13 13:57:38.925760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 146/285] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:38 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:39.127362 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:39.128507 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:39.157894 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.160954 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.165409 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.166271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.244600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-04aca3b1-15f9-4e54-abb9-18baaa61fd11 req-ce3065bf-2927-43b1-9614-4d16c21cb92b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4da520-c7a6-46c2-905f-6ebe28df0fda", "name": "network-vif-plugged", "status": "completed", "tag": "3affb7e8-3e00-4de2-bf21-04a103f2d90e"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:39.261291 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-04aca3b1-15f9-4e54-abb9-18baaa61fd11 req-ce3065bf-2927-43b1-9614-4d16c21cb92b service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.271548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-04aca3b1-15f9-4e54-abb9-18baaa61fd11 req-ce3065bf-2927-43b1-9614-4d16c21cb92b service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.291782 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-04aca3b1-15f9-4e54-abb9-18baaa61fd11 req-ce3065bf-2927-43b1-9614-4d16c21cb92b service nova] Creating event network-vif-plugged:3affb7e8-3e00-4de2-bf21-04a103f2d90e for instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda on hv-cinder-84175 May 13 13:57:39.299118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-04aca3b1-15f9-4e54-abb9-18baaa61fd11 req-ce3065bf-2927-43b1-9614-4d16c21cb92b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058364 May 13 13:57:39.300854 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 147/286] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:39.424644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:39.444327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0fe64ae4-f0ea-4c12-8090-2073a6383d32 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.322619 May 13 13:57:39.445887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 140/287] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:39 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:39.540305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:39.541040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:39.553869 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.554971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.557015 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.557475 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.764997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:39.773296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-561c918b-397f-49d7-b2de-b8a8e27f7185 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.240529 May 13 13:57:39.773962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 148/288] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:39 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:39.946120 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:39.946780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:39.953606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.954886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:39.955692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:39.956142 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:40.033897 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:40.042486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b871215c-2625-473f-8270-ffc5a33ca678 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1222 microversion: 2.1 time: 0.100810 May 13 13:57:40.043655 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 141/289] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:39 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1222 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:40.473888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:40.476719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:40.491142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:40.491606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:40.492817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:40.493273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:40.650821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:40.662160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-91aeae8b-ca7c-46e8-9658-57be1aadaebf tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1313 microversion: 2.1 time: 0.194053 May 13 13:57:40.672170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 149/290] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:40 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:40.791165 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:40.792364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:40.801514 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:40.802011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:40.803073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:40.803663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.001041 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:41.013665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4a581094-e4ea-475c-8530-95a39ef94b22 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.227537 May 13 13:57:41.015326 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 142/291] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:40 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:41.061096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.061968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.068453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.068898 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.069947 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.070566 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.164526 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:41.178073 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7e16e0b2-ee7f-497e-b363-7ec266f9dc84 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1270 microversion: 2.1 time: 0.121016 May 13 13:57:41.179358 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 150/292] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1270 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:41.679352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:41.679961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:41.691171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.691694 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.694337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:41.694819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:41.869583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:41.873307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1191f668-33e7-4aa9-930b-e2f5f9c29bc7 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1497 microversion: 2.1 time: 0.197727 May 13 13:57:41.874356 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 143/293] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:41 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1497 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:42.042207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.043071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.050658 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.051140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.052092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.052576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.204530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.205361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.217579 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.218029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.218862 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.219304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.296504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:42.306455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-605708f4-bfdd-4705-b404-7a55ecb9f6a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.268629 May 13 13:57:42.307593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 151/294] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:42 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:42.326389 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:42.337576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fe9cd76c-e6e5-4745-ad15-8eb740c81d71 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1278 microversion: 2.1 time: 0.136825 May 13 13:57:42.338167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 144/295] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:42 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1278 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:42.651226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.657104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.676755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.677348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.678420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.679306 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.732154 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:57:42.946372 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-88f9e646-3965-446b-aa9f-c22e2015e08d tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 204 len: 0 microversion: 2.1 time: 0.302358 May 13 13:57:42.955244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 152/296] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 13:57:42 2022] DELETE /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:57:42.962118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:42.963171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:42.980939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.981574 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:42.983800 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:42.984429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.150180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:43.168934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a7487c2e-d00c-4531-9d6b-69d9359bb0d0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1503 microversion: 2.1 time: 0.210832 May 13 13:57:43.171021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 145/297] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:42 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1503 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:43.333409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:43.334381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:43.344746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.345537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.346958 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.347753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.364748 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:43.365279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:43.373886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.374615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.375594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:43.376644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:43.607623 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:43.615983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:43.616822 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dc1065de-78ff-4683-9e83-c79dcf97c80a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.295076 May 13 13:57:43.617210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 153/298] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:43 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:43.625243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f751872a-032f-4587-a4a9-ed91e1c6378a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.271168 May 13 13:57:43.625974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 146/299] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:43 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:44.190530 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.191265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:44.198589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.199877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.200732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.201288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.401227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:44.410041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9d9fb614-fe4d-471a-be44-e1ef88cbf180 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1503 microversion: 2.1 time: 0.223995 May 13 13:57:44.410636 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 154/300] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:44 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:44.638948 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.640124 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:44.650860 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:44.652758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.653554 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.654600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.655074 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.655914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:44.681498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.687708 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.690451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:44.691464 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:44.873875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:44.885196 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:44.885686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-551565b9-8fd2-4b69-b9e4-b52dd0431bb9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.253995 May 13 13:57:44.887256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 147/301] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:44 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:44.894452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9caaf3b0-da6a-47f7-9e29-4ef9428c4857 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.255286 May 13 13:57:44.895282 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 155/302] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:44 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:45.427209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:45.427812 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:45.434376 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.434847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.435634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.436066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.582262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:45.592066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2a17fec4-85d6-407b-8055-a98f9cf0d7c0 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1503 microversion: 2.1 time: 0.168391 May 13 13:57:45.592651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 148/303] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:45 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:45.906525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:45.907198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:45.913637 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:45.914433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:45.920887 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.921343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.921486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.921801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.922337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.922577 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:45.923054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:45.923690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:46.145897 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:46.148123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:46.153656 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ec8eacdb-718f-4cd6-9065-6c6fefb69f9a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.250997 May 13 13:57:46.154243 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 156/304] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:45 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:46.163117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c7e9acb0-d060-4f1a-9f2c-f0a44d66e76f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.252763 May 13 13:57:46.164213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 149/305] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:45 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:46.610828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:46.611371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:46.618073 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:46.618621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:46.619561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:46.620012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:46.789150 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:46.796835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ba35a82b-0ce7-4f69-9a8d-f35c105df7d4 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1503 microversion: 2.1 time: 0.190036 May 13 13:57:46.797415 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 157/306] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:46 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1503 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:47.170679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:47.171264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:47.178023 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.178475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.179283 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.179729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.186802 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:47.187500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:47.193968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.194411 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.195223 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.195657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.429104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:47.439823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:47.443877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-92b6da20-4823-4f6e-9623-f6e398dfc018 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.262572 May 13 13:57:47.445157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 158/307] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:47 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:47.454675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e18f429d-cfbc-4cf8-868c-a55d31724bef tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.287309 May 13 13:57:47.456492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 150/308] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:47 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:47.816576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:47.817921 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:47.829330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.830419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:47.832121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:47.833299 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.332763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:48.347390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c351adef-bcab-4322-9583-518c28006a80 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1503 microversion: 2.1 time: 0.536552 May 13 13:57:48.348643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 159/309] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:47 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1503 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:48.404224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-3d0500d7-1ab4-4839-bd32-894b8cfa382f req-e7912fd6-7ae3-4358-bae5-0c284c5ea718 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64d3002e-b010-4a1b-900b-ea079465a93e", "tag": "260d78f5-565f-48bf-bc2f-22b683574971"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:48.431696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-3d0500d7-1ab4-4839-bd32-894b8cfa382f req-e7912fd6-7ae3-4358-bae5-0c284c5ea718 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.432847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-3d0500d7-1ab4-4839-bd32-894b8cfa382f req-e7912fd6-7ae3-4358-bae5-0c284c5ea718 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.471608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-3d0500d7-1ab4-4839-bd32-894b8cfa382f req-e7912fd6-7ae3-4358-bae5-0c284c5ea718 service nova] Creating event network-changed:260d78f5-565f-48bf-bc2f-22b683574971 for instance 64d3002e-b010-4a1b-900b-ea079465a93e on hv-cinder-84175 May 13 13:57:48.475559 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:48.476863 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:48.485966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-3d0500d7-1ab4-4839-bd32-894b8cfa382f req-e7912fd6-7ae3-4358-bae5-0c284c5ea718 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098696 May 13 13:57:48.487053 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 151/310] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:57:48.487816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.488692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.490022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.490811 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.498306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:48.499523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:48.513287 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.514353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:48.516267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:48.517300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.015627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:49.026469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ca4ee9cd-dd47-4dcf-93b5-ab41204e04d3 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.553594 May 13 13:57:49.027793 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 160/311] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:48 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:49.112098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:49.122911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4b168f80-0a6f-418e-a38d-47e00b51d350 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.633681 May 13 13:57:49.135503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 152/312] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:48 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:49.373580 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:49.373580 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:49.379719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.380161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.380982 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.381433 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.409936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-78301c1d-918d-438b-a1ad-c9ec1c4caecc req-caa24655-ad27-46d6-a47e-cc283339bde1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b4da520-c7a6-46c2-905f-6ebe28df0fda", "name": "network-vif-deleted", "tag": "3affb7e8-3e00-4de2-bf21-04a103f2d90e"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:57:49.419597 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-78301c1d-918d-438b-a1ad-c9ec1c4caecc req-caa24655-ad27-46d6-a47e-cc283339bde1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:49.420330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-78301c1d-918d-438b-a1ad-c9ec1c4caecc req-caa24655-ad27-46d6-a47e-cc283339bde1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:49.445710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-78301c1d-918d-438b-a1ad-c9ec1c4caecc req-caa24655-ad27-46d6-a47e-cc283339bde1 service nova] Creating event network-vif-deleted:3affb7e8-3e00-4de2-bf21-04a103f2d90e for instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda on hv-cinder-84175 May 13 13:57:49.454353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-78301c1d-918d-438b-a1ad-c9ec1c4caecc req-caa24655-ad27-46d6-a47e-cc283339bde1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047604 May 13 13:57:49.455358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 153/313] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:57:49.469957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:49.482668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e5d8ac4f-89a4-4e7e-ada4-7f12902fbe2e tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1461 microversion: 2.1 time: 0.114230 May 13 13:57:49.483361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 161/314] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:49 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1461 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:50.045997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.046702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.052976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.053434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.054224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.054661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.140933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.141545 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.147807 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.148266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.149052 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.149494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.192353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:50.200758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-39c94e7b-04bd-40ce-9d41-1a59f79290e6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.158989 May 13 13:57:50.201345 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 154/315] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:50.294554 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:50.302176 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d9f1fa39-2b31-4e4b-b70a-795bae0756b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.166096 May 13 13:57:50.302851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 162/316] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:50.500924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:50.501481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:50.508204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.508650 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.509437 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:50.509871 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:50.574736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:50.582153 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3ce2af2f-b384-4ded-97a2-24b973ad27da tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1461 microversion: 2.1 time: 0.085207 May 13 13:57:50.582775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 155/317] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:50 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:51.217795 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:51.218398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:51.224252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.224691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.225451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.225881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.319675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:51.320392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:51.326953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.327464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.328311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.328808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.361830 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:51.371948 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-31a255cb-15c4-4252-b267-5da88e525123 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.157705 May 13 13:57:51.374662 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 163/318] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:51 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:51.479872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:51.488574 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e79c1c9c-fb84-4314-8e0a-390aca7dccc0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.172716 May 13 13:57:51.489148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 156/319] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:51 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:51.601506 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:51.602061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:51.608886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.612601 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.612601 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:51.612601 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:51.673816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:51.681652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-097566db-91e6-4bd2-9863-49aa81dc0584 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1461 microversion: 2.1 time: 0.084107 May 13 13:57:51.682228 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 164/320] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:51 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:52.388593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:52.389210 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:52.395632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.396086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.396865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.397304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.505745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:52.506302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:52.512903 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.513428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.514224 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.514662 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.528389 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:52.535880 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2cc557a0-a71c-423f-a136-aa8ed759b136 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.151687 May 13 13:57:52.536476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 157/321] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:52 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:52.657093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:52.664912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4a941a2e-1b55-4be9-90c6-f8eaae4b7b74 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.163090 May 13 13:57:52.665497 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 165/322] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:52 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:52.699155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:52.699822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:52.706012 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.706461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.707276 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:52.707713 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:52.771928 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:52.779553 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fe5e12c3-937e-4c4a-b7c2-fc047d0c4410 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1461 microversion: 2.1 time: 0.084507 May 13 13:57:52.780133 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 158/323] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:52 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1461 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:53.554187 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:53.555191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:53.566983 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.567473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.568524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.568882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.682341 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:53.683706 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:53.691353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.692803 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.694188 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.695115 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.711068 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:53.719266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-054a09e9-890f-4466-b7d7-2e314c714f9f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.169243 May 13 13:57:53.719845 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 166/324] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:53 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:53.796933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:53.797469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:53.803704 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.804156 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.805218 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:53.805687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:53.836506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:53.845128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d836b20f-c0d6-42b4-a640-4ff85e50facc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.166840 May 13 13:57:53.845707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 159/325] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:53 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:53.871021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:53.878672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f1099c4e-8ec7-4520-940e-7b714729c617 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1461 microversion: 2.1 time: 0.085777 May 13 13:57:53.879261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 167/326] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:53 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:54.736620 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:54.737226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:54.743864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.744312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.745086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.745695 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.870880 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:54.871608 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:54.876584 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:54.877894 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.878516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.879514 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.879954 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.883911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e5d505aa-0596-4105-bc82-a5651a5a88c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.151141 May 13 13:57:54.884773 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 160/327] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:54 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:54.898721 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:54.899379 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:54.906857 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.907302 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.908082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:54.908517 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:54.982740 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:54.997760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-80acee73-d417-4d2f-a6a6-a1fbbdfb4eb2 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1461 microversion: 2.1 time: 0.102690 May 13 13:57:54.998607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 161/328] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:54 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1461 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:55.047806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:55.055571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7392d30b-e703-495d-ac17-58e8a6c66973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.188614 May 13 13:57:55.056172 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 168/329] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:54 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:55.901253 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:55.902529 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:55.908985 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.909475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:55.910315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:55.910769 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.015472 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:56.016084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:56.022226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.022679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.023504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.023930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.112299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:56.115083 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ef0eaa76ffe4b62a132f0f4ee595a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '703aa4774820401da920e420eb6181d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:56.124038 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0535a992-87bb-47b7-8417-35e800c60914 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.226683 May 13 13:57:56.124553 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a0b1b8d2-8941-4591-ae9a-4c4134586475 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 200 len: 1298 microversion: 2.1 time: 0.113344 May 13 13:57:56.127235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 169/330] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:56 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 1298 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:56.134245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 162/331] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:55 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:56.140525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:56.141193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:56.148627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.149081 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.149847 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:56.150277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:56.301608 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:56.310236 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-31db5aae-d85d-407f-ac85-e21483e5f8d6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.174063 May 13 13:57:56.310928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 170/332] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:56 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:57.141788 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:57.143269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:57.145456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:57.146234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] [instance: 4b4da520-c7a6-46c2-905f-6ebe28df0fda] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:57.150744 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.151157 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.152392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.153194 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.154847 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.157682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.158991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.159685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.180970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] HTTP exception thrown: Instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda could not be found. May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Request method failure captured: May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda HTTP/1.1 May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmOIY73FIzbZIP6koNbSJln1kJ0JIbsCZR55JvPCtng17s86wXBcsaJRzpwR8186GKbiwKKjkDAkO5PkFvkieYNe6hWSO8s_UXaxV7ab1AKX_lS8eUt6VVZzijXdfdDqv2-oBe_G9jHLMHDGN2EYU8ouYotWaowhoB49wgejym0ZEgs May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 703aa4774820401da920e420eb6181d9 May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesActionsTest-480609634 May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:57:57.182632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/703aa4774820401da920e420eb6181d9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/703aa4774820401da920e420eb6181d9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/703aa4774820401da920e420eb6181d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_703aa4774820401da920e420eb6181d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesActionsTest-480609634 May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 703aa4774820401da920e420eb6181d9 May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesActionsTest-480609634 May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesActionsTest-480609634-project May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 8ef0eaa76ffe4b62a132f0f4ee595a6f May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesActionsTest-480609634-project May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda could not be found. May 13 13:57:57.184329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '4b4da520-c7a6-46c2-905f-6ebe28df0fda'} May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda could not be found. May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:57:57.188815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda could not be found. May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda could not be found. May 13 13:57:57.190050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:57:57.191648 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] Returning 404 to user: Instance 4b4da520-c7a6-46c2-905f-6ebe28df0fda could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:57:57.191648 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-94e30718-ad49-477f-8ea2-9a2bc1b99e09 tempest-VolumesActionsTest-480609634 tempest-VolumesActionsTest-480609634-project] 10.222.0.79 "GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda" status: 404 len: 111 microversion: 2.1 time: 0.044550 May 13 13:57:57.191648 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 171/333] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:57 2022] GET /compute/v2.1/servers/4b4da520-c7a6-46c2-905f-6ebe28df0fda => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:57:57.327909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:57.329705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:57.330315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:57.338502 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.338862 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-15679969-a74f-47f7-8767-9536f17277d1 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.200526 May 13 13:57:57.340232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.340644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 163/334] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:57 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:57.342236 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:57.343353 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:57.498899 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:57.507083 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-962518df-10f6-4fbb-99b1-cbb93b788a6c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.182285 May 13 13:57:57.507759 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 172/335] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:57 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:58.359105 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:58.360134 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:58.368094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:58.368735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:58.369689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:58.370255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:58.518986 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:58.525900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:58.527325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:58.531707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-544b24c2-7188-4021-a28a-a00a2dd47aa9 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.178084 May 13 13:57:58.532306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 164/336] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:58 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:58.534653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:58.535147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:58.535927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:58.536362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:58.678056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:58.686490 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-eadcf134-6252-4468-8bb3-1cd7c70342ac tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.164868 May 13 13:57:58.687029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 173/337] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:58 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:57:59.549214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:59.549858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:59.556334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.556783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.557631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.559350 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.703041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:57:59.703704 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:57:59.706913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:59.710134 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.710617 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.711350 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:57:59.711786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:57:59.720341 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8e4e5c1e-d568-477c-a51b-0c25e7be30bf tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.174955 May 13 13:57:59.721024 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 165/338] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:59 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:57:59.860243 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:57:59.867810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1af121a6-0a1a-48e8-9c32-5deb78681163 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.168776 May 13 13:57:59.868453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 174/339] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:57:59 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:00.745545 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:00.746066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:00.752548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.752998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.753859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.754211 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.884886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:00.885505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:00.888762 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:00.893713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.894175 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.895009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:00.895447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:00.896408 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d7ae686d-3ef9-422b-8b3e-ddd8a33e6fdc tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.154879 May 13 13:58:00.896983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 166/340] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:00 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:01.041344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:01.050606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-faca996f-a606-4c9b-9bc2-923152b9bead tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.169526 May 13 13:58:01.051428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 175/341] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:00 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:01.562122 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-a7d19588-9076-4d80-8bcc-05b6d93be2ca req-f495994f-50f8-4572-af2a-d25e814973cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d3002e-b010-4a1b-900b-ea079465a93e", "name": "network-vif-plugged", "status": "completed", "tag": "260d78f5-565f-48bf-bc2f-22b683574971"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:01.571917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-a7d19588-9076-4d80-8bcc-05b6d93be2ca req-f495994f-50f8-4572-af2a-d25e814973cf service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.572348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-a7d19588-9076-4d80-8bcc-05b6d93be2ca req-f495994f-50f8-4572-af2a-d25e814973cf service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.583668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-a7d19588-9076-4d80-8bcc-05b6d93be2ca req-f495994f-50f8-4572-af2a-d25e814973cf service nova] Creating event network-vif-plugged:260d78f5-565f-48bf-bc2f-22b683574971 for instance 64d3002e-b010-4a1b-900b-ea079465a93e on hv-cinder-84175 May 13 13:58:01.590384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-a7d19588-9076-4d80-8bcc-05b6d93be2ca req-f495994f-50f8-4572-af2a-d25e814973cf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031670 May 13 13:58:01.591123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 167/342] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:01.913531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:01.914688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:01.920912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.921349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:01.922122 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:01.922549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:02.055175 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:02.063594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d23de8d3-83b2-4636-a39e-c64d0150488e tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.154021 May 13 13:58:02.064168 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 176/343] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:01 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:02.068931 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:02.069637 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:02.077078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:02.077534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:02.078318 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:02.078785 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:02.218216 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:02.225736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f080538c-18eb-476b-a499-77039dd58c53 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.161589 May 13 13:58:02.226311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 168/344] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:02 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:03.080617 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:03.081255 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:03.087324 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:03.087768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:03.088531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:03.089469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:03.227454 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:03.235275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9c8abc1b-2b3f-4e61-9c2a-3bb2d6eb164a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.158461 May 13 13:58:03.237284 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 177/345] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:03 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:03.242315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:03.243007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:03.249579 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:03.250330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:03.250844 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:03.251306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:03.387655 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:03.395574 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-92d69c5a-42a4-412a-af41-4dce7072c4dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.157005 May 13 13:58:03.396140 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 169/346] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:03 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:04.254218 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:04.254882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:04.260828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:04.261286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:04.262060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:04.262501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:04.399343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:04.407649 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-999a8bb7-0f6f-4c24-acbe-e80c403cdb90 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.157371 May 13 13:58:04.408226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 178/347] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:04 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:04.413039 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:04.413657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:04.420709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:04.421190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:04.421966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:04.422406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:04.554006 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:04.561813 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6a00b8dd-bcd8-4f18-9d2b-10d1ad2f79c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.152514 May 13 13:58:04.562290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 170/348] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:04 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:05.424337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:05.424921 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:05.431872 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:05.432387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:05.433173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:05.433605 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:05.577064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:05.582165 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:05.582811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:05.585572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-971b7a60-7796-440d-adc8-9fe67f09f881 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1318 microversion: 2.1 time: 0.164980 May 13 13:58:05.586155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 179/349] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:05 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:05.590533 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:05.590991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:05.591789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:05.592208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:05.734607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:05.742248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1272485d-731f-4c58-822d-d3fb59e187e0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.164111 May 13 13:58:05.742869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 171/350] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:05 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:06.613999 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:06.617463 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:06.628734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:06.629578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:06.631356 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:06.632671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:06.764407 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:06.765562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:06.787677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:06.788136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:06.788938 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:06.789390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:06.794390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:06.803332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c4cb114b-6ed6-4b46-b2ad-598a132fc3f0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1508 microversion: 2.1 time: 0.200614 May 13 13:58:06.816500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 180/351] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:06 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:07.040173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:07.050784 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dbf3dd9f-6220-4fc3-bdec-a02c894969b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.293676 May 13 13:58:07.057753 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 172/352] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:06 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:08.074060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:08.074666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:08.080771 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:08.081228 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:08.082006 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:08.082452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:08.211768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:08.219214 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d1970879-0fd1-49ea-86eb-5a8eb12c9dc9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.149505 May 13 13:58:08.219786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 181/353] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:08 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:09.236352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:09.236958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:09.243611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:09.244056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:09.244835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:09.245266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:09.376399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:09.384281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-65243db7-d298-41b9-b2f1-faf6b10af2bf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.151762 May 13 13:58:09.384854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 173/354] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:09 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:10.410010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:10.410873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:10.418796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:10.419538 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:10.420312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:10.420749 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:10.590143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:10.598125 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9a36d376-023a-40bc-9a18-59e910604051 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.193712 May 13 13:58:10.598731 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 182/355] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:10 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:11.620626 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:11.621969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:11.628649 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:11.629245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:11.630869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:11.630869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:11.784452 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:11.793123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4bcf4e0b-ef4f-4062-84e2-f0df79d4b824 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.179381 May 13 13:58:11.793701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 174/356] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:11 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:12.811420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:12.812259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:12.818060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:12.818500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:12.819289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:12.819780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:13.070087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:13.078483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4b08d749-19d7-4ad2-afb0-0d83a2f7b24b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.271499 May 13 13:58:13.082916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 183/357] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:12 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:14.096973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:14.098336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:14.105693 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:14.106378 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:14.107348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:14.107853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:14.271706 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:14.279646 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7c4254d3-2af3-4797-9091-e58f6a592267 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.186640 May 13 13:58:14.280206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 175/358] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:14 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:15.297111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:15.297710 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:15.304431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:15.304877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:15.305634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:15.306064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:15.450140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:15.462255 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-72429061-d01c-4052-b627-7b90f1cb0950 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.168590 May 13 13:58:15.464443 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 184/359] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:15 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:16.487971 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:16.489050 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:16.496094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:16.496899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:16.497917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:16.498590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:16.664379 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:16.672779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fa0efc81-3c73-4170-a9ef-cefab2747501 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.189061 May 13 13:58:16.682575 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 176/360] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:16 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:17.689477 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:17.690186 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:17.696745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:17.697271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:17.698062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:17.698504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:17.884422 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:17.895023 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-409182c6-4329-4df5-9505-332ffd89f8af tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.209273 May 13 13:58:17.906064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 185/361] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:17 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:18.919739 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:18.920421 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:18.927262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:18.927715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:18.928508 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:18.929570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:19.108862 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:19.117424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c037cbfc-8fd4-4699-999b-4d269e459967 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.202277 May 13 13:58:19.118013 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 177/362] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:18 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:20.136094 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:20.136719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:20.169128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:20.169609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:20.171543 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:20.171543 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:20.326774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:20.336112 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-54d42974-7c10-4483-a801-1fb245e73785 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.203990 May 13 13:58:20.338790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 186/363] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:20 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:20.851172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:20.852632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:20.860319 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:20.861155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:20.861987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:20.862728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:20.890176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d54b9d95-51c9-4773-9aa1-7bf42d2fbad5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/ips" status: 200 len: 150 microversion: 2.1 time: 0.042941 May 13 13:58:20.891116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 178/364] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 13:58:20 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:21.355221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:21.355841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:21.362241 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:21.362690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:21.363532 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:21.363972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:21.501481 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:21.509000 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cdec5d67-fdb2-40d9-8ec6-637922ef4973 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.158414 May 13 13:58:21.510011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 187/365] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:21 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:22.378179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9496dec8-c8ae-4228-88ef-6042309b3414"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:22.379372 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:22.380281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:22.381187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:22.387015 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.387371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.388181 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.388812 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.389310 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.389882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.390815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.391363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.419678 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-850e6c1a-f445-411f-ae2f-7cb891d876e0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/ips" status: 200 len: 153 microversion: 2.20 time: 0.045543 May 13 13:58:22.421252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 179/366] 10.222.0.79 () {60 vars in 1288 bytes} [Fri May 13 13:58:22 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:58:22.525563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:22.526312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:22.532709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.533171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.533997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:22.534435 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:22.702436 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:22.710983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0137bdae-eccb-4142-adbd-68debe1ac5cd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.189312 May 13 13:58:22.719644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 180/367] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:22 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:22.799201 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4ddf4df2-b5c8-43d8-89d0-ed5383fef97c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.424761 May 13 13:58:22.799881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 188/368] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:58:22 2022] POST /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 194 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:58:23.737842 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:23.738534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:23.745885 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:23.746413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:23.747399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:23.747833 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:23.890525 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:23.898747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-15c29481-adfc-410a-a20f-edc5b0a091b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.164996 May 13 13:58:23.899503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 181/369] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:23 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:24.918919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:24.920141 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:24.928298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:24.929339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:24.930222 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:24.931061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:25.081311 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:25.089716 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-33b9f6f6-84f2-470f-901b-baefe706c2dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.177507 May 13 13:58:25.090285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 189/370] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:24 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:26.108572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:26.109302 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:26.116159 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:26.116696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:26.117542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:26.118051 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:26.277031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:26.297716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1b4c7082-250d-4978-9774-90da638336b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.195022 May 13 13:58:26.298306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 182/371] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:26 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:27.317325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:27.318697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:27.326669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:27.327252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:27.328342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:27.328870 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:27.481397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:27.493173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-898a7b01-709c-4786-9db1-ca36616a5aea tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.180165 May 13 13:58:27.493719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 190/372] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:27 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:28.516539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:28.519331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:28.529377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:28.530283 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:28.531445 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:28.532042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:28.688266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:28.695624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-44004a4c-7246-42e4-b34e-df2a1a336da6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.186482 May 13 13:58:28.696175 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 183/373] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:28 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:29.103963 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:29.104560 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:29.110913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:29.111362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:29.112135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:29.112572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:29.134901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lazy-loading 'flavor' on Instance uuid 19b01326-65de-403a-8020-724b6563fa64 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:58:29.716859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:29.717519 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:29.724770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:29.725287 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:29.726100 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:29.726548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:29.872357 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:29.880416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cb035a55-7784-4049-a122-1d4d83d799a7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.169508 May 13 13:58:29.881282 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 184/374] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:29 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:30.898997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:30.900518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:30.927651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:30.928815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:30.929780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:30.930103 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:31.118429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:31.128105 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1c02aba1-0fab-4a72-b95e-9244a8cdc2b6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.232888 May 13 13:58:31.138414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 185/375] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:30 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:31.552817 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ad6c4fc7-4538-4bb5-ab54-ec4ffd3d8647 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: .version_select at 0x7fb3be678f70>, body: {"keypair": {"name": "tempest-keypair-2069255686", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqnF3i7Z5vgNvlFT41/6oVnNZ2BQ26KryR4ijZEF+ZxylszI2hdT2Mc5CT+0catYgG58mkCyLnf/RZQXglM+OUsO1WDZVgv+FJx03ZH+jUb8uFiXpsU9qoZhVolloWpSw=="}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:31.586875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-ad6c4fc7-4538-4bb5-ab54-ec4ffd3d8647 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:58:31.594693 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-ad6c4fc7-4538-4bb5-ab54-ec4ffd3d8647 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:58:31.656723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ad6c4fc7-4538-4bb5-ab54-ec4ffd3d8647 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.108543 May 13 13:58:31.657324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 186/376] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 13:58:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:58:32.146554 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:32.147927 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:32.156199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:32.156746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:32.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:32.157864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:32.369218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:32.379073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-66c3ab10-48d5-42b2-93d3-bf6920e5e368 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.236250 May 13 13:58:32.380224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 187/377] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:32 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:33.364422 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1118457948", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed6b2694-1b8c-422b-965c-287402920164"}], "security_groups": [{"name": "tempest-securitygroup--101269970"}], "key_name": "tempest-keypair-2069255686", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:35.665648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] validate_networks() for [('ed6b2694-1b8c-422b-965c-287402920164', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:58:35.827460 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-10979b4a-ae91-496b-9cfb-48946ffad339 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/action" status: 202 len: 0 microversion: 2.20 time: 6.727491 May 13 13:58:35.828215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 191/378] 10.222.0.79 () {62 vars in 1318 bytes} [Fri May 13 13:58:29 2022] POST /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/action => generated 0 bytes in 6729 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:58:35.839181 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:35.839967 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:35.847349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:35.848143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:35.848970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:35.849646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:36.131496 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:36.141123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e60c827e-52db-4118-aed1-91e6091d2d64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.307345 May 13 13:58:36.141981 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 192/379] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:35 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:36.147554 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:36.148412 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:36.156466 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:36.157165 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:36.158197 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:36.158818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:36.395791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:36.409250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:36.410927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:36.412247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dda15ff4-4ab3-401e-8b17-e815c307fdd8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.268977 May 13 13:58:36.412835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 193/380] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:36 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:36.445039 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:58:36.445989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:58:36.447549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:58:36.448278 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:58:36.449005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:58:36.464256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:36.464992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:36.466393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:36.467193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:36.505226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:58:36.512398 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:58:36.530352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:58:36.534517 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:58:36.593589 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1a3c25a8-8596-441b-962d-7e46e3cbc7a9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.233436 May 13 13:58:36.594235 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 188/381] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:58:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 3235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 13:58:36.604345 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-369d1f9c-2edf-4744-a8ba-44f494e7e4a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:36.604962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-369d1f9c-2edf-4744-a8ba-44f494e7e4a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:36.665291 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-369d1f9c-2edf-4744-a8ba-44f494e7e4a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:36.675711 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-369d1f9c-2edf-4744-a8ba-44f494e7e4a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1242 microversion: 2.1 time: 0.074934 May 13 13:58:36.676403 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 194/382] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:36 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:37.012294 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:37.016070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:37.037728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.039374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.041653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.042990 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.140099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4df1d059-b669-4a18-bf07-94253181f511 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/ips" status: 200 len: 146 microversion: 2.1 time: 0.136622 May 13 13:58:37.152218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 189/383] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 13:58:37 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/ips => generated 146 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:37.168119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:37.170458 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:37.192042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.194368 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.196426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.197769 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.349282 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:37.358244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dd290e69-2077-4e0e-aa61-f873e9ce5e6e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.202199 May 13 13:58:37.358842 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 195/384] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:37 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:37.432910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:37.433899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:37.440530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.440982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.441804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.442243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.660731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:37.669776 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:37.671499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:37.672808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7a11a186-257a-463e-890f-1d719633bb63 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.244741 May 13 13:58:37.673464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 190/385] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:37 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:37.694631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:37.696959 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:37.705190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.706695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:37.707196 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:37.772166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:37.780645 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-38184d46-0087-45b6-a4a6-6c87202b3675 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1294 microversion: 2.1 time: 0.090756 May 13 13:58:37.782021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 196/386] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:37 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1294 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:38.375667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:38.376286 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:38.383248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:38.383730 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:38.385002 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:38.385709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:38.568394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:38.578656 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2df624d6-c55e-4b54-89b3-9ee2e217a3fd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.206906 May 13 13:58:38.580693 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 191/387] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:38 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:38.691133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:38.692473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:38.700009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:38.700651 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:38.701530 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:38.702029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:38.797801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:38.798427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:38.809405 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:38.809856 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:38.810661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:38.818393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:39.089577 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:39.098996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-36929870-78dc-45fb-ad83-7597111a8cd4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1294 microversion: 2.1 time: 0.305350 May 13 13:58:39.105220 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 192/388] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:38 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1294 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:39.265191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:39.314491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:39.319743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:39.331508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a5dfaaf6-0124-4706-8982-a263db19f0b3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.643433 May 13 13:58:39.334531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 197/389] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:38 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:39.597113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:39.598431 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:39.606993 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:39.607795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:39.608958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:39.609546 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:39.792042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:39.801801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bd1893ad-6e6e-429d-a275-958039f73df1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1523 microversion: 2.1 time: 0.208617 May 13 13:58:39.802791 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 193/390] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:39 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1523 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:40.124221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:40.125884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:40.133179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:40.134469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:40.135760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:40.137077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:40.247100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:40.255834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c73daa2f-015d-42b2-bdb0-222f2ed3babf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1300 microversion: 2.1 time: 0.137320 May 13 13:58:40.256427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 198/391] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:40 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1300 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:40.353104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:40.353709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:40.359544 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:40.359997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:40.360781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:40.361254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:40.579592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:40.595829 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:40.607764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:40.614615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f1f4639d-46c4-4cb6-ab9d-312d6a62ba69 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.265438 May 13 13:58:40.615232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 194/392] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:40 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:40.834662 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:40.837471 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:40.851104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:40.853475 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:40.854643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:40.855645 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:41.188929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:41.206438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-221361ef-d6e5-4b7b-add6-288615dfb28d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1503 microversion: 2.1 time: 0.383771 May 13 13:58:41.230557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 199/393] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:40 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1503 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:41.236416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:41.237034 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:41.250615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:41.252778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:41.253352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:41.253874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:41.273289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:41.275032 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:41.295918 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:41.296315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:41.311650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:41.312176 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:41.459072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:41.489354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:41.498312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f64404fd-eb72-4cee-bd27-5797ab2db8a1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1300 microversion: 2.1 time: 0.215279 May 13 13:58:41.502432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a4a397b9-e89b-47d8-baac-d25146fad734 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1515 microversion: 2.1 time: 0.275342 May 13 13:58:41.503367 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 195/394] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:41 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1515 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:41.512639 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 200/395] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:41 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1300 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:41.635347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:41.636882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:41.652101 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:41.653566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:41.655838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:41.658336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:42.034863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:42.054974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:42.057897 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:42.060551 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-82804e8b-a53a-4ec6-b1a0-e5cca2f41eb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.430722 May 13 13:58:42.061316 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 196/396] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:41 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:42.503696 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c3ea828-1b77-4ba4-86fa-e197a10f1d77"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:42.504801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:42.511944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:42.512388 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:42.513371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:42.514006 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:42.517415 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:42.518255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:42.526164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:42.527011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:42.528008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:42.528669 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:42.880141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:42.888550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8fedfd7e-5a93-4b5d-9fb9-9192adef5b32 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.374832 May 13 13:58:42.889146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 197/397] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:42 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:43.003426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-19e33d67-7279-4588-a959-13175fd09f00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501391 May 13 13:58:43.004350 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 201/398] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:58:42 2022] POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-volume_attachments => generated 194 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:43.088582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:43.090016 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:43.111822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.112647 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.115139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.116749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.382431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:43.386208 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:43.437774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.439337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.440180 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.440629 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.474348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'flavor' on Instance uuid 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:58:43.583690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:43.598951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:43.601679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:43.605032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5903330e-162a-414b-a29f-102a354465ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.528550 May 13 13:58:43.607313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 198/399] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:43 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:43.616617 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9a6c5454-c9d4-4070-8d7d-fab8f22abab8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/action" status: 200 len: 32 microversion: 2.1 time: 0.244988 May 13 13:58:43.617169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 202/400] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 13:58:43 2022] POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/action => generated 32 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 13:58:43.636145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:43.636828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:43.646019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.646765 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.647724 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.648170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.734480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d16e9081-d147-4fe7-8646-c2cae1f7f052", "device": "/dev/sdb"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:43.736363 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:43.743096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.743912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.745167 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.745751 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.896883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:43.907231 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7f19a27f-bf0b-4da1-8663-015ff48ff7e4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.276749 May 13 13:58:43.918295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 199/401] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:43 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:43.924363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-f759db6b-419b-4bb7-86f8-f0f0f166e903 req-46f39cc5-87de-4a99-8ffe-73fde121ecae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1309a28e-544d-4d0d-a42e-4a5be1b1ddb6", "tag": "88a82195-7c42-46b1-8e8d-08caa5d38af4"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:43.934495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-f759db6b-419b-4bb7-86f8-f0f0f166e903 req-46f39cc5-87de-4a99-8ffe-73fde121ecae service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.935236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-f759db6b-419b-4bb7-86f8-f0f0f166e903 req-46f39cc5-87de-4a99-8ffe-73fde121ecae service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.947503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-f759db6b-419b-4bb7-86f8-f0f0f166e903 req-46f39cc5-87de-4a99-8ffe-73fde121ecae service nova] Creating event network-changed:88a82195-7c42-46b1-8e8d-08caa5d38af4 for instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 on hv-cinder-84175 May 13 13:58:43.952944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-f759db6b-419b-4bb7-86f8-f0f0f166e903 req-46f39cc5-87de-4a99-8ffe-73fde121ecae service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032244 May 13 13:58:43.953629 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 200/402] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:43.963875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:43.964865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:43.971847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.972579 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:43.973527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:43.974097 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:44.150293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a17cf278-db28-431f-bada-22b45c27c0d0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "POST /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.420446 May 13 13:58:44.158068 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 203/403] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:58:43 2022] POST /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e/os-volume_attachments => generated 194 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:58:44.223823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:44.232588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-33c7017a-afca-4673-959e-e1c1509a43f8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.278030 May 13 13:58:44.233383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 201/404] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:43 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:44.626149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:44.626883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:44.633187 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:44.633537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:44.634314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:44.634775 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:44.772978 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:44.781341 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:44.782872 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:44.784037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e6f5b31b-93f1-49ff-a90b-f38f8cfa3b9d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.162689 May 13 13:58:44.784656 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 204/405] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:44 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:58:44.925256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:44.925874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:44.933027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:44.933478 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:44.934255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:44.934694 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:45.079777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:45.087899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-682be65a-a0d4-45f7-b04c-0e15177e64e9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.166383 May 13 13:58:45.088482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 202/406] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:44 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:45.250524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:45.251398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:45.268124 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:45.268798 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:45.269672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:45.270117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:45.409695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:45.418578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cb5beef4-aee5-430e-afc4-f503060c4fe2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.171911 May 13 13:58:45.419220 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 205/407] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:45 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:45.805295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:45.805797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:45.815840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:45.816299 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:45.817091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:45.817528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:46.049129 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:46.059281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:46.059583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:46.060715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-07336f23-3a29-43ca-b74a-48be378e7e50 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.259874 May 13 13:58:46.061263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 203/408] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:45 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:46.107046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:46.107738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:46.119961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:46.120694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:46.122226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:46.123851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:46.318136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:46.328762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cb56e697-d656-442c-8189-1e7bab036e13 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.226516 May 13 13:58:46.329655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 206/409] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:46 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:46.436237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:46.436951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:46.443139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:46.443939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:46.444574 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:46.445082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:46.744623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:46.752260 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e3bd929a-024f-49f7-9c4b-f0f90a2b9c72 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.320065 May 13 13:58:46.752846 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 204/410] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:46 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:47.079536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:47.080426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:47.089033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:47.089627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:47.090404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:47.091152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:47.316193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:47.326012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:47.333483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:47.334917 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cc842d53-bc2f-40d0-9720-f45db29ba5d2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.259284 May 13 13:58:47.335763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 207/411] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:47 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:47.345935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:47.347441 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:47.359348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:47.361072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:47.361967 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:47.362509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:47.554056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:47.562321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-24182730-0f0b-46c2-9006-0af1f1cf8413 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.220209 May 13 13:58:47.563438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 205/412] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:47 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:47.769670 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:47.770379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:47.776888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:47.777581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:47.778366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:47.779983 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:47.977298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:47.986398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-73a67bd5-6a34-49c7-b0ec-6bdb89cdf74f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.220790 May 13 13:58:47.987032 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 208/413] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:47 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:48.356559 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:48.357187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:48.363874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:48.364203 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:48.364992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:48.365435 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:48.534682 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:48.544056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:48.546253 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:48.547592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9856a498-5aa5-416a-9b9a-739eead6653f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.195981 May 13 13:58:48.550881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 206/414] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:48 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:48.580055 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:48.580698 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:48.587706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:48.588154 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:48.588930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:48.589365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:48.726951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:48.735237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-410db443-333a-4c76-908f-2adc8fa519f4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.158933 May 13 13:58:48.735810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 209/415] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:48 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:49.004293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:49.005243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:49.011644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.012084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.012867 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.013342 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.143206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:49.151590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-844c6293-ada4-47fe-b59a-3cea21ba71ee tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.151372 May 13 13:58:49.152158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 207/416] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:48 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:49.566884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:49.567556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:49.574313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.575061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.575908 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.576354 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.738240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:49.749129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:49.750980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:49.752548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3c77d74f-8e15-4fc9-bd5a-b8afa811c0be tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.190272 May 13 13:58:49.753636 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 210/417] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:49 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:49.760690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:49.762502 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:49.776515 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.776973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.777774 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.778212 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.916667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:49.924800 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b5f709dd-607c-491d-8cdd-a9dfff35b4aa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.174362 May 13 13:58:49.925484 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 208/418] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:49 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:49.959914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-a4412c6a-2a17-4c71-ad24-fac2fb9837cc req-24934b85-2ccb-4a2f-98eb-bf69a2871182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1309a28e-544d-4d0d-a42e-4a5be1b1ddb6", "name": "network-vif-plugged", "status": "completed", "tag": "88a82195-7c42-46b1-8e8d-08caa5d38af4"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:49.968674 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-a4412c6a-2a17-4c71-ad24-fac2fb9837cc req-24934b85-2ccb-4a2f-98eb-bf69a2871182 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:49.969118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-a4412c6a-2a17-4c71-ad24-fac2fb9837cc req-24934b85-2ccb-4a2f-98eb-bf69a2871182 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:49.981489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-a4412c6a-2a17-4c71-ad24-fac2fb9837cc req-24934b85-2ccb-4a2f-98eb-bf69a2871182 service nova] Creating event network-vif-plugged:88a82195-7c42-46b1-8e8d-08caa5d38af4 for instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 on hv-cinder-84175 May 13 13:58:49.986503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-a4412c6a-2a17-4c71-ad24-fac2fb9837cc req-24934b85-2ccb-4a2f-98eb-bf69a2871182 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030133 May 13 13:58:49.987063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 211/419] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:50.169082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:50.169700 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:50.175660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:50.176046 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:50.176831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:50.177266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:50.357031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:50.364333 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9fdfdcc7-5534-459a-9471-a1df93ab6a82 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.199728 May 13 13:58:50.364888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 209/420] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:50 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:50.776590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:50.777352 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:50.783593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:50.784045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:50.784823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:50.785256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:50.932628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:50.941817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:50.943382 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:50.943846 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:50.944472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:50.944566 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5018420b-e395-47a6-8acc-90843e5f3ebb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.173144 May 13 13:58:50.951725 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 212/421] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:50 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:50.951854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:50.951946 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:50.953086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:50.953731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:51.091680 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:51.099146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1310127a-1613-4d7d-8624-d70153fb2812 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.160819 May 13 13:58:51.099707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 210/422] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:50 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:51.382017 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:51.382852 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:51.392361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:51.392922 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:51.393900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:51.394511 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:51.534489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:51.543500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-69f64972-8022-40ea-b8fe-02bd32613aac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1367 microversion: 2.1 time: 0.165726 May 13 13:58:51.544183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 213/423] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:51 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:51.963521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:51.964209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:51.970491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:51.970979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:51.971747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:51.972180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.103267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:52.111822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:52.113207 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:52.114479 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-50e67e73-6db5-4a85-9c6d-69dac6bfa190 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.155470 May 13 13:58:52.115252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 211/424] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:51 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:52.116773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:52.117379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:52.124045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:52.124492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.125308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:52.125772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.260192 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:52.267637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3a3c4e58-32a2-4c5a-a985-7415d502ec64 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.154646 May 13 13:58:52.268205 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 214/425] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:52 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:52.561888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:52.562405 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:52.568369 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:52.568813 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.569582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:52.570013 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.700335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:52.716320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e1c757e9-78b5-4f50-aedd-70d8522f504c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1557 microversion: 2.1 time: 0.157622 May 13 13:58:52.717233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 212/426] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:52 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1557 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:52.733877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:52.734521 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:52.742234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:52.743906 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.744773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:52.745571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:52.836131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c58181b9-603b-475f-b957-f730f5f4092d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106508 May 13 13:58:52.836728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 215/427] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 13:58:52 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:53.133854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:53.134628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:53.141548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:53.142149 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:53.143055 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:53.143572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:53.284738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:53.285351 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:53.292130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:53.292600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:53.293361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:53.293797 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:53.637608 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:53.642702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:53.652181 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2ddd2a6f-ebe7-4400-bcb8-6e5127882dbb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.371261 May 13 13:58:53.652762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 216/428] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:53 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:53.652980 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:53.656171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:53.657625 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-42184358-8ad4-4c79-a499-925ddc5b7db8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.527559 May 13 13:58:53.658348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 213/429] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:53 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:54.332694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-d5b47a7a-4a63-4abe-a6bf-e6b46e95b5ac req-d8658899-9e1c-48c6-bf9f-695d7a8db4e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1309a28e-544d-4d0d-a42e-4a5be1b1ddb6", "tag": "88a82195-7c42-46b1-8e8d-08caa5d38af4"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:54.342011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-d5b47a7a-4a63-4abe-a6bf-e6b46e95b5ac req-d8658899-9e1c-48c6-bf9f-695d7a8db4e4 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:54.342564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-d5b47a7a-4a63-4abe-a6bf-e6b46e95b5ac req-d8658899-9e1c-48c6-bf9f-695d7a8db4e4 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:54.355040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-d5b47a7a-4a63-4abe-a6bf-e6b46e95b5ac req-d8658899-9e1c-48c6-bf9f-695d7a8db4e4 service nova] Creating event network-changed:88a82195-7c42-46b1-8e8d-08caa5d38af4 for instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 on hv-cinder-84175 May 13 13:58:54.360204 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-d5b47a7a-4a63-4abe-a6bf-e6b46e95b5ac req-d8658899-9e1c-48c6-bf9f-695d7a8db4e4 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033640 May 13 13:58:54.361250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 217/430] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:54.670158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:54.672236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:54.678173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:54.679369 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:54.680602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:54.681433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:54.682737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:54.683482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:54.687320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:54.688646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:54.689657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:54.690322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:55.002417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:55.012333 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:55.013854 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:55.015190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-56c0870e-70a6-4fc0-84c1-b8192fd55448 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1745 microversion: 2.20 time: 0.341763 May 13 13:58:55.015833 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 218/431] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:54 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1745 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:55.021251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-37fed38d-85b3-40f1-8b89-e0ea079ccae9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:55.030633 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:55.042831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d39a54aa-b45e-4b7d-89b7-3986bbc55109 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.376319 May 13 13:58:55.049564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-37fed38d-85b3-40f1-8b89-e0ea079ccae9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:55.050248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-37fed38d-85b3-40f1-8b89-e0ea079ccae9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:55.053952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 214/432] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:54 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:55.125287 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-37fed38d-85b3-40f1-8b89-e0ea079ccae9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Going to try to stop instance {{(pid=123512) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 13:58:55.174348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-37fed38d-85b3-40f1-8b89-e0ea079ccae9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action" status: 202 len: 0 microversion: 2.1 time: 0.156930 May 13 13:58:55.175283 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 219/433] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 13:58:55 2022] POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:58:55.183933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:55.184547 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:55.190781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:55.191239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:55.192018 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:55.192449 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:55.335166 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:55.344151 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-10d09ab3-f793-4f63-ba5c-6a6b5e58b9ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.164103 May 13 13:58:55.344771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 215/434] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:55 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:55.836842 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-f2f2fb8d-5e8c-4dc2-bd94-a3acfa9e2dfd req-8f58e394-6116-48af-8984-808e2645c44a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "name": "network-vif-plugged", "status": "completed", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:58:55.847932 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-f2f2fb8d-5e8c-4dc2-bd94-a3acfa9e2dfd req-8f58e394-6116-48af-8984-808e2645c44a service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:55.848376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-f2f2fb8d-5e8c-4dc2-bd94-a3acfa9e2dfd req-8f58e394-6116-48af-8984-808e2645c44a service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:55.861541 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-f2f2fb8d-5e8c-4dc2-bd94-a3acfa9e2dfd req-8f58e394-6116-48af-8984-808e2645c44a service nova] Creating event network-vif-plugged:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 13:58:55.867207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-f2f2fb8d-5e8c-4dc2-bd94-a3acfa9e2dfd req-8f58e394-6116-48af-8984-808e2645c44a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034459 May 13 13:58:55.868806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 220/435] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:58:56.038973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:56.040219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:56.047693 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:56.048146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:56.048927 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:56.049361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:56.061297 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:56.062462 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:56.068824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:56.069636 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:56.070474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:56.071002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:56.271471 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:56.275129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:56.283056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8694e157-b8b0-4a3c-b3b5-eea7e9618d2a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.226005 May 13 13:58:56.283639 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 221/436] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:56 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:58:56.287610 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:56.289729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:56.290939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1965b49f-1d9b-43de-9f55-b41fbe01f89d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1745 microversion: 2.20 time: 0.255992 May 13 13:58:56.291493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 216/437] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:56 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1745 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:56.361521 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:56.362085 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:56.368784 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:56.369236 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:56.370027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:56.370462 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:56.517282 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:56.526920 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-46dd4ae3-a94d-42e4-ae54-d0cbf5eb9e41 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.169227 May 13 13:58:56.527563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 222/438] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:56 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:57.303984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:57.305237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:57.312882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:57.313763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:57.325591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:57.326011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:57.326825 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:57.327953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:57.328406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:57.329376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:57.333898 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:57.334425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:57.579585 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:57.591267 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:57.596287 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:57.599183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5db31614-0cf6-40b6-b6ee-3be6a12490d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.290047 May 13 13:58:57.600490 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 223/439] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:57 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:57.606850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:57.607683 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:57.608204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:57.614553 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:57.615091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:57.615882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:57.615988 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3504d79f-8ac5-4514-9a60-4f94234861c4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.318299 May 13 13:58:57.616325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:57.616498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 217/440] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:57 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:57.781936 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:57.791894 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-237c9f0a-32b2-4ea4-b88e-c4dabadd650b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.188366 May 13 13:58:57.793032 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 224/441] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:57 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:58.625917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:58.626826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:58.635516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:58.636746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:58.643406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:58.643852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:58.644854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:58.645297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:58.646156 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:58.646734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:58.647956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:58.654757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:58.907273 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:58.924599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:58.928429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:58.930922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ee70c0ca-6cf4-4e2d-9ed8-3b686e0a07ca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.315538 May 13 13:58:58.932251 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 218/442] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:58 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:58:58.948333 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:58.949351 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:58.956135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:58.956899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:58.957889 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:58.958528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:58.960690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:58.973662 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6e82b4ed-279b-44b2-98a5-40f006258959 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.343491 May 13 13:58:58.986753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 225/443] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:58 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:59.134379 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:58:59.145849 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-22d5709a-d6d8-48ff-93d9-31a2d8532ced tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.201443 May 13 13:58:59.147759 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 219/444] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:58 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:58:59.950183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:59.951072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:58:59.964436 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:59.964988 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:59.965860 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:58:59.966477 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:58:59.991909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:58:59.994061 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:00.052192 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:00.057150 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:00.058296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:00.058966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:00.207074 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:00.216783 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:00.220161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:00.221946 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b5435c38-70c9-4f9a-8eff-50c8c566b38c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.276234 May 13 13:59:00.222876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 226/445] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:58:59 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:00.237210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:00.237840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:00.245994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:00.246957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:00.249013 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:00.249452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:00.323685 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:00.334027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f9285b4d-c8a9-4d1f-a55b-85fa6c19f630 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.346421 May 13 13:59:00.335147 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 220/446] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:58:59 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:00.449990 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:00.471234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8032a704-01d6-4b7b-95a0-f89e8a6ed705 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.246888 May 13 13:59:00.472081 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 227/447] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:00 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:01.244106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:01.245978 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:01.254809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.255626 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.256436 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.256883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.356292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:01.357087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:01.367471 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.367924 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.368724 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.369232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.579385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:01.592263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:01.594529 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:01.595964 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ac9dec25-c71b-4dc1-947e-5a3191a78325 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.358038 May 13 13:59:01.596629 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 221/448] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:01 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:01.617975 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:01.620219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:01.631385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.633051 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.635534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:01.636696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:01.678837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:01.690476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0e246613-3083-468f-a520-4529fec7be8b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.340985 May 13 13:59:01.704053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 228/449] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:01 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:01.899189 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:01.930619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-28416401-a622-4730-91a1-4620246242bb tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.320233 May 13 13:59:01.933060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 222/450] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:01 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:02.631440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:02.632668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:02.658574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:02.659468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:02.661111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:02.661754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:02.713233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:02.718921 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:02.744606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:02.745486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:02.747809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:02.749162 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:03.047256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:03.058876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:03.060860 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:03.062320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3dd6d607-bf83-416c-9b6c-81be6cdd135a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.449919 May 13 13:59:03.063964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 229/451] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:02 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:03.069482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:03.070429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:03.079011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:03.080018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:03.081401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:03.082035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:03.093783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:03.123278 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0317604d-d12f-4a5b-a3fe-064c8aab6b0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.402271 May 13 13:59:03.130860 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 223/452] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:02 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:03.326265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:03.341839 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4e47ab31-7b53-458e-8d32-57cf8d4b195b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.275973 May 13 13:59:03.343237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 230/453] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:03 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:04.089698 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:04.090404 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:04.098184 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.098677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.099744 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.100343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.157680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:04.158343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:04.168858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.184019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.188797 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.189635 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.360569 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.377467 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.380956 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.383664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-935a6511-820d-40f4-b74d-45851706bee6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.299348 May 13 13:59:04.385142 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 224/454] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:04 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:04.394433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:04.396494 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:04.407947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.408733 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.410808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:04.411877 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:04.418659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.435890 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d89bde3a-08d7-4701-8f1a-7e279d820985 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.282188 May 13 13:59:04.437540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 231/455] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:04 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:04.654826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:04.673840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d383f5f9-f11c-415f-b3fc-b7fc6ee32d95 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.278654 May 13 13:59:04.673840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 225/456] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:04 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:05.403589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:05.405080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:05.412821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:05.414772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:05.415587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:05.416321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:05.456921 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:05.458310 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:05.466427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:05.467370 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:05.468339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:05.468923 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:05.977438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:05.987189 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:05.989593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:05.991197 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b810afbf-954f-4a2e-a2a8-85b87b13b541 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.591562 May 13 13:59:06.005162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 232/457] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:05 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:06.015119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:06.016717 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:06.026143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:06.027220 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:06.028886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:06.029720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:06.050192 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:06.066791 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-220738dc-3e82-428a-a700-52e5e06c9dc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.615768 May 13 13:59:06.068953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 226/458] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:05 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:06.287174 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:06.298261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-989f8d85-fe42-4f19-ac90-28ccd7cf46c2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.291593 May 13 13:59:06.298920 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 233/459] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:06 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:07.013017 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:07.014576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:07.027598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.028010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.028834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.029281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.093841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:07.094479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:07.102425 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.103166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.104718 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.105236 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.311085 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.325943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.328179 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.329808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5526a4c4-9831-4d38-b789-15b90b6e6cee tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.323653 May 13 13:59:07.330466 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 227/460] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:07 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:07.335990 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:07.336984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:07.338384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.349920 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a4cb1705-da21-41c7-87bd-5d51f430f3a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.262505 May 13 13:59:07.351540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 234/461] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:07 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:07.357521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.360590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.360590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:07.360590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:07.584085 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:07.605429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2f92985e-ba57-4405-8975-512267df714e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.265335 May 13 13:59:07.605429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 228/462] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:07 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:08.350533 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:08.351870 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:08.360341 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.360801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.361671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.362108 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.369864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:08.370877 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:08.385906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.386672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.388158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.388962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.648800 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.657077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.658733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.660738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.662997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-02d799dd-7273-4aa2-a19c-347330e80a04 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.315781 May 13 13:59:08.663575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 235/463] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:08 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:08.668474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:08.669093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:08.670956 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-87db6e70-d229-46f1-a91e-f16e61c67d28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.305344 May 13 13:59:08.671769 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 229/464] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:08 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:08.675842 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.676297 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.677081 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:08.677789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:08.856428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:08.864912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-56e0d036-8c53-43b7-9daa-608c76d5345d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.200279 May 13 13:59:08.865502 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 236/465] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:08 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:09.690588 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:09.691997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:09.693652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:09.696314 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:09.700115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:09.700608 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:09.701488 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:09.701951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:09.708230 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:09.709079 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:09.710591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:09.711267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:09.996167 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.003656 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.006202 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bd9f94ea-6437-469b-8e6a-9b88be484669 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.320208 May 13 13:59:10.006947 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 237/466] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:09 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:10.012834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:10.013821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:10.014136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.016205 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.017619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c4074b1b-4cab-4955-bc9b-1b52cc599af9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1740 microversion: 2.20 time: 0.331673 May 13 13:59:10.018456 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 230/467] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:09 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1740 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:10.020609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:10.021093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:10.021941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:10.022380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:10.192618 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:10.201798 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d061d9d1-448b-4e71-bdcf-2d7cdbe1ca9c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.193511 May 13 13:59:10.202407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 238/468] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:10 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:11.027453 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:11.028291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:11.037642 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.038797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.040128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.040953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.043829 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:11.045199 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:11.051901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.052865 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.053666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.054650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.373872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:11.380857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:11.388556 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c1b8bc9c-b4fb-4f80-9ae7-f42eb8585a28 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.365782 May 13 13:59:11.389156 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 231/469] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:11 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:11.394155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:11.394793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:11.411571 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.412130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.413108 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:11.413630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:11.419485 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:11.421563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:11.423627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-342b4481-3f1b-41e7-ab16-014c90118829 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.383559 May 13 13:59:11.424712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 239/470] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:11 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:11.672344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:11.687222 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8d24e9cd-13ab-4a1a-839a-16dfe4371975 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.296666 May 13 13:59:11.687864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 232/471] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:11 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:12.423768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:12.424376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:12.433821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:12.435166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.436012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:12.436979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.451176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:12.452074 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:12.463425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:12.463899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.464962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:12.465490 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.696529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.705324 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-50893833-2cf5-43ac-af81-bfa913738217 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.289228 May 13 13:59:12.716052 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 240/472] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:12 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:12.721790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:12.722409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:12.729201 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:12.729715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.730809 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:12.731494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:12.739711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.754415 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.756823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.761448 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d6886362-2f42-471c-8c81-582a80ba3a93 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.312374 May 13 13:59:12.768952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 233/473] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:12 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:12.943705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:12.973236 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a526d4bd-c8b7-4d15-bc03-a5e4e4de8761 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.254618 May 13 13:59:12.973997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 241/474] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:12 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:13.730586 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:13.731859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:13.747123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:13.748522 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:13.749620 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:13.750247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:13.787460 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:13.788346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:13.797598 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:13.798217 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:13.799631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:13.800447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:14.154769 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.173596 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-412b206e-11e1-42b2-a5b1-46c30a3b17b3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.446883 May 13 13:59:14.174695 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 234/475] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:13 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:14.195317 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:14.197320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:14.211009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:14.212015 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:14.214781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:14.216102 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:14.240717 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.271582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.276819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.279063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1498c6db-2d12-4b9a-89a1-d3125877c01f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.498630 May 13 13:59:14.280574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 242/476] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:13 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:14.574922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:14.590090 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f145d04a-3559-4fce-a052-d72e81a54fa8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1725 microversion: 2.1 time: 0.413361 May 13 13:59:14.590699 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 235/477] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:14 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1725 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:15.206131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:15.208103 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:15.220371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.221681 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.224441 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.226039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.313262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:15.314407 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:15.328501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.328973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.330406 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.331519 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.693875 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.706696 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-63369aa3-fbb2-493f-b640-1392b28c6e50 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1501 microversion: 2.1 time: 0.507846 May 13 13:59:15.707644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 243/478] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:15 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1501 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:15.718040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:15.719449 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:15.731929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.732777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.733893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.734480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.788689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.804504 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.806727 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:15.816402 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9ff7a381-9e0e-445a-a8c6-4ce93f14738c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.511031 May 13 13:59:15.820784 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 236/479] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:15 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:15.842632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f27cdc59-10af-4278-8540-29940865981b"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:15.844978 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:15.861547 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.862361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.864764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.866952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.932420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] HTTP exception thrown: Cannot 'attach_volume' instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a while it is in vm_state rescued May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Request method failure captured: May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/os-volume_attachments HTTP/1.1 May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 74 May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOEHon-fechDwOfswGzRSlb13P_LLN7cMvEy5OQpOne3xef0PIi_Am7bNyBj-G90Vj_3-vuk46lJcBaW_wNBY3h7_ahKSU_kO0-pqOwsYA7AFwdnEZTkX6KxTynMEapY_6ISEbfWwuohB9BUCNLQk_WGYutwAYMFRpJbGaSwZXWVtM May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ef89791b177f4bf0ba916f133c79f33a May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 13:59:15.940989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ef89791b177f4bf0ba916f133c79f33a May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 20fd230cc30f4980bedebc75c620d707 May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {"volumeAttachment": {"volumeId": "f27cdc59-10af-4278-8540-29940865981b"}} May 13 13:59:15.942947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Cannot 'attach_volume' instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a while it is in vm_state rescued May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'server_id': '3c44ce14-5d23-453e-bfde-1fb8c8d74c2a', 'body': {'volumeAttachment': {'volumeId': 'f27cdc59-10af-4278-8540-29940865981b'}}} May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:59:15.943689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a while it is in vm_state rescued May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:59:15.945088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a while it is in vm_state rescued May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Returning 409 to user: Cannot 'attach_volume' instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a while it is in vm_state rescued {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ef9e857a-b888-434d-b159-0c41e36c233e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.121863 May 13 13:59:15.946368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 237/480] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:59:15 2022] POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/os-volume_attachments => generated 152 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 13:59:15.959796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:15.960952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:15.992456 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.995012 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:15.997295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:15.998462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.115620 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:16.131446 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7aa48a84-56a9-441f-8160-682fdfb42ed6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1702 microversion: 2.1 time: 0.421668 May 13 13:59:16.133537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 244/481] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:15 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1702 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:16.153162 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-976dfa71-9f02-4b89-9ae9-476cb93de5dd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/action" status: 202 len: 0 microversion: 2.1 time: 0.200662 May 13 13:59:16.164516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-308bae35-8986-431d-9026-29572118e89b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:16.170645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 238/482] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 13:59:15 2022] POST /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:59:16.183540 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:16.184601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:16.188348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-308bae35-8986-431d-9026-29572118e89b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.189558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-308bae35-8986-431d-9026-29572118e89b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.203942 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.204716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.206060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.206747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.248642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-308bae35-8986-431d-9026-29572118e89b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Going to try to start instance {{(pid=123512) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 13:59:16.361584 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-308bae35-8986-431d-9026-29572118e89b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action" status: 202 len: 0 microversion: 2.1 time: 0.204506 May 13 13:59:16.371024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 245/483] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 13:59:16 2022] POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 13:59:16.377058 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:16.378127 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:16.391160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.391828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:16.394159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:16.394698 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:17.049051 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:17.058466 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8cae2918-6078-423a-a51d-1bfd0ee15073 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1509 microversion: 2.1 time: 0.885246 May 13 13:59:17.059482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 239/484] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:16 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1509 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:17.064945 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:17.065964 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:17.080660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:17.080660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:17.080660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:17.080660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:17.284328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:17.298725 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a21feb29-ef2e-4d75-aa18-be4bcc118c4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1711 microversion: 2.1 time: 0.925665 May 13 13:59:17.299707 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 246/485] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:16 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1711 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:17.407804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:17.419198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:17.422224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:17.424036 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7143693e-3702-473b-8e5c-dd8343a76ec8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.363682 May 13 13:59:17.424839 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 240/486] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:17 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:17.702780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-2ed7c1c3-b325-443e-8e53-0e795efa8fc8 req-b3fe49ff-5f6a-430c-bc7e-7231b23e7fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "name": "network-vif-unplugged", "status": "completed", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:17.728775 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-2ed7c1c3-b325-443e-8e53-0e795efa8fc8 req-b3fe49ff-5f6a-430c-bc7e-7231b23e7fc1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:17.729631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-2ed7c1c3-b325-443e-8e53-0e795efa8fc8 req-b3fe49ff-5f6a-430c-bc7e-7231b23e7fc1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:17.781756 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-2ed7c1c3-b325-443e-8e53-0e795efa8fc8 req-b3fe49ff-5f6a-430c-bc7e-7231b23e7fc1 service nova] Creating event network-vif-unplugged:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 13:59:17.796575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-2ed7c1c3-b325-443e-8e53-0e795efa8fc8 req-b3fe49ff-5f6a-430c-bc7e-7231b23e7fc1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102027 May 13 13:59:17.798477 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 247/487] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:59:18.085804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:18.088040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:18.097079 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:18.098070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.099856 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:18.101455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.330129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:18.334558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:18.337031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.345295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:18.345738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d519dfc4-c872-4b00-83fa-6d3ae63d0a0d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1509 microversion: 2.1 time: 0.268795 May 13 13:59:18.346589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.348378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:18.349284 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.349589 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 241/488] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:18 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:18.449062 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:18.450634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:18.469794 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:18.470517 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.471669 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:18.472348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:18.809383 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.824275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b7c8d6dd-6831-49e4-ae2b-5bd78a1f261b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1711 microversion: 2.1 time: 0.503359 May 13 13:59:18.824564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.837518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.837518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:18.837518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f2a6ecf5-7446-40f8-86fe-6e629cc218a0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.395620 May 13 13:59:18.838272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 242/489] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:18 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:18.838866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 248/490] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:18 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1711 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:19.374104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:19.375303 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:19.402080 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.402952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.404128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.404946 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.726919 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:19.741851 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-83cc20b0-327c-4a80-9b3a-49821e190eec tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1509 microversion: 2.1 time: 0.375437 May 13 13:59:19.744691 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 243/491] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:19 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1509 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:19.868342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:19.869466 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:19.873265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:19.874301 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:19.887145 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.888318 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.889680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.890334 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.893449 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.895221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:19.898480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:19.901606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:20.253468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.268304 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0ac6487f-31b4-48b9-a448-f7e6611bb587 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1711 microversion: 2.1 time: 0.417935 May 13 13:59:20.268806 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.277035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 249/492] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:19 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1711 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:20.299314 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.302843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:20.308093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9cef279f-245b-4918-a35d-18b57a4f330e tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1722 microversion: 2.20 time: 0.454141 May 13 13:59:20.322764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 244/493] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:19 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1722 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:20.775878 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:20.777482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:20.793065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:20.793860 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:20.795009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:20.795760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.278833 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.289307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:21.290652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:21.290944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9dac11ef-f6fb-4da4-9afc-dee788d4f443 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1509 microversion: 2.1 time: 0.526635 May 13 13:59:21.292081 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 250/494] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:20 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:21.301614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.302918 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.304437 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.305401 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.357129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:21.360355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:21.384440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.385610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.387173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.387977 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.765957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.778162 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d372778e-dc76-491a-bd0f-cb441f9011b8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1711 microversion: 2.1 time: 0.495811 May 13 13:59:21.779783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 245/495] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:21 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1711 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:21.829726 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.859076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.862091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:21.869365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5ef15692-d431-429c-87e6-9e0f73b25b14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1725 microversion: 2.20 time: 0.530234 May 13 13:59:21.870167 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 251/496] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:21 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1725 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:21.893717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92511fd1-ff71-49d6-ac6a-c9758d5645d1"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:21.897966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:21.940764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.948370 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:21.951183 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:21.952210 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.331634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:22.334205 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:22.352620 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.354914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.357168 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.358304 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.581078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-57c90022-bf11-40c4-88ed-36a5c58454bb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.695867 May 13 13:59:22.583893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 246/497] 10.222.0.79 () {62 vars in 1363 bytes} [Fri May 13 13:59:21 2022] POST /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments => generated 188 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 13:59:22.660872 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:22.665276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-679e456a-eb4d-4a7c-b9d7-2fdd5bc5ef10 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1509 microversion: 2.1 time: 0.347632 May 13 13:59:22.669211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 252/498] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:22 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1509 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:22.801394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:22.802121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:22.806067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:22.807417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:22.816102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.816895 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.820555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.820555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.828931 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.830058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:22.831074 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:22.831627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.034745 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4a6ace45-8839-4c67-bc8e-058ab4285410 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/action" status: 202 len: 0 microversion: 2.20 time: 0.250165 May 13 13:59:23.035363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 247/499] 10.222.0.79 () {62 vars in 1318 bytes} [Fri May 13 13:59:22 2022] POST /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 13:59:23.047070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.049633 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:23.050816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:23.060854 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ef39f023-c819-44c8-ab7e-bdd2deb53563 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1711 microversion: 2.1 time: 0.267143 May 13 13:59:23.062796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 253/500] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:22 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1711 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:23.066298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:23.066773 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.067569 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:23.068355 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.101923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:23.102785 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:23.122512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:23.123247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.124564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:23.125564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.377824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lazy-loading 'services' on Instance uuid 64d3002e-b010-4a1b-900b-ea079465a93e {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:59:23.411312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.423822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.426328 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:23.430876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-891605a3-8726-4dc3-88d2-98cd6d707d23 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1811 microversion: 2.20 time: 0.387923 May 13 13:59:23.442887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 248/501] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:23 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1811 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:23.623753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1bdee9f2-0c4d-449a-90a2-d66f755a7f1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "DELETE /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e/os-volume_attachments/d16e9081-d147-4fe7-8646-c2cae1f7f052" status: 202 len: 0 microversion: 2.1 time: 0.528627 May 13 13:59:23.630753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 254/502] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 13:59:23 2022] DELETE /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e/os-volume_attachments/d16e9081-d147-4fe7-8646-c2cae1f7f052 => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 13:59:23.689842 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:23.691148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:23.698753 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:23.699741 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:23.700869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:23.702217 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.041751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.057053 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2b8792b4-d9a2-462c-9a48-16ecdeefae38 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1509 microversion: 2.1 time: 0.374374 May 13 13:59:24.071065 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 249/503] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:23 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1509 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:24.082678 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:24.083374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:24.091573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:24.092329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.093428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:24.094050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.332434 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.343729 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-db0be6f7-e5f4-4c74-a857-d86ed31e03a6 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1711 microversion: 2.1 time: 0.267300 May 13 13:59:24.344408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 255/504] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:24 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1711 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:24.454396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:24.455852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:24.476265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:24.478884 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.480790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:24.487075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:24.753433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.764724 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.766381 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:24.767561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bf3f440f-8396-4f57-9edd-f765095f226f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1751 microversion: 2.20 time: 0.321350 May 13 13:59:24.780014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 250/505] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:24 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1751 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:25.080871 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:25.081589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:25.091996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.093413 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.094653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.095342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.294913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:25.310349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-82a7ae25-de49-405c-b4b8-a3263a4f14b1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1515 microversion: 2.1 time: 0.233403 May 13 13:59:25.312415 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 256/506] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:25 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1515 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:25.377159 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:25.377882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:25.391831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.392305 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.393187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.393637 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.650738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:25.684084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-72250c14-a886-49c8-ba10-b1e83f884323 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1715 microversion: 2.1 time: 0.317365 May 13 13:59:25.684943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 251/507] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:25 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1715 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:25.789885 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:25.790964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:25.810014 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.811148 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:25.812535 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:25.813167 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:26.122001 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:26.140773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:26.143419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:26.148571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7ac675c0-3b0f-47fd-a40e-5d25a9c4a9f4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1751 microversion: 2.20 time: 0.365381 May 13 13:59:26.155123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 257/508] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:25 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1751 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:27.175309 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:27.176079 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:27.190096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:27.193356 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:27.195145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:27.197109 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:27.271905 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c308d156-225d-4b75-a13d-5282ee2392df tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'create', calling method: .version_select at 0x7fb3bdedd8b0>, body: {"keypair": {"name": "tempest-keypair-1465732726", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGKzQ6cH1HXf648ypBcMXNFrgF0/oVvhJackjZkr5eHw/HlVCOdadWgSAT+NbkTf8eCX71XIolWJw4CLbgPq/DmcN4d5A6h8zBpzB2GqOtWfilB9ryIB9E0pV0lgT2jNRg=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:27.336374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-c308d156-225d-4b75-a13d-5282ee2392df tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for project ef89791b177f4bf0ba916f133c79f33a. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:59:27.341368 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-c308d156-225d-4b75-a13d-5282ee2392df tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for user 20fd230cc30f4980bedebc75c620d707 and project ef89791b177f4bf0ba916f133c79f33a. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:59:27.382495 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c308d156-225d-4b75-a13d-5282ee2392df tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [cdb42d46-8591-4ef6-9949-225f84df6f34] AMQP server on 10.222.0.79:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 13:59:27.519753 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:27.538861 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:27.540473 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:27.541720 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fc6391c8-a665-4896-8f4b-2e813228788f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1753 microversion: 2.20 time: 0.371558 May 13 13:59:27.555328 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 252/509] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:27 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1753 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:28.250313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:28.251026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:28.277648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.278137 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.278998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.279439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.388502 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:59:28.391765 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO oslo.messaging._drivers.impl_rabbit [None req-c308d156-225d-4b75-a13d-5282ee2392df tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [cdb42d46-8591-4ef6-9949-225f84df6f34] Reconnected to AMQP server on 10.222.0.79:5672 via [amqp] client with port 46036. May 13 13:59:28.427510 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c308d156-225d-4b75-a13d-5282ee2392df tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.160923 May 13 13:59:28.434082 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 258/510] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 13:59:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:59:28.570555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:28.571588 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:28.588061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.591878 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.607782 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.612929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.650331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-63d64617-bd2d-4e97-907a-452b9d245c4d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "DELETE /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 204 len: 0 microversion: 2.1 time: 0.405670 May 13 13:59:28.654788 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 253/511] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 13:59:28 2022] DELETE /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 13:59:28.666879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:28.669226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:28.689632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.690093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.691119 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:28.691572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:28.950144 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:28.967524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:28.969644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:28.971173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8268932a-c9a2-4dde-88c6-54ba447b5d86 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.413531 May 13 13:59:28.984030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 259/512] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:28 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:29.034260 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:29.045992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-844703d4-f3cc-4b95-bfdd-44ea9d6b4fb6 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1514 microversion: 2.1 time: 0.389428 May 13 13:59:29.046591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 254/513] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:28 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1514 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:30.005926 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:30.007523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:30.019184 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:30.019639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:30.020455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:30.020908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:30.093453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e8bd8011-faaa-4550-a172-4e9ee2c53513 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Action: 'create', calling method: .version_select at 0x7fb3bde17280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-323121193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLaq/BojEfdKpCHS2EChQA60BsHV7ekNIs9cYjkyeGdX3IVV7LYNvspZKbCMOzjr9ior/SrQn4onwln4lfl64uWASCbIJPwpS2JQQ5lfY0ESMbhvXoNbgXfZutqth/gCQ=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:30.143029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-e8bd8011-faaa-4550-a172-4e9ee2c53513 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:59:30.152536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-e8bd8011-faaa-4550-a172-4e9ee2c53513 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for user a27e83f9f5fb4a0b99e7fac6ab90b3e4 and project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:59:30.201277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e8bd8011-faaa-4550-a172-4e9ee2c53513 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.303306 May 13 13:59:30.203702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 260/514] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 13:59:29 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:30.209590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:30.210438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:30.232274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:30.233528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:30.235268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:30.235893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:30.283933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.299432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.304306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.306054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-860db676-9266-4dea-b446-00995ce3e47b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.316002 May 13 13:59:30.320155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 255/515] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:29 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:30.519121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:30.542143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-37314a7f-1167-4f35-af87-56545ef072e7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1514 microversion: 2.1 time: 0.335911 May 13 13:59:30.547834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 261/516] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:30 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1514 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:31.132540 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-774146676", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37774d91-9a21-4c82-acd7-acc4b660f52e"}], "security_groups": [{"name": "tempest-securitygroup--2131542550"}], "key_name": "tempest-keypair-1465732726", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:31.327782 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:31.328395 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:31.346054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:31.346652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:31.351739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:31.352555 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:31.796767 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] validate_networks() for [('37774d91-9a21-4c82-acd7-acc4b660f52e', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:59:32.077474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.104449 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.106523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.109479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-72360833-cf12-4303-8ae3-af72e8727ace tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.787209 May 13 13:59:32.114929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 262/517] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:31 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:32.136833 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:32.138189 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:32.151076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.151832 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.155348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.156191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.220649 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.221651 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.223277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lazy-loading 'fault' on Instance uuid 64d3002e-b010-4a1b-900b-ea079465a93e {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 13:59:32.330490 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:32.348528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0fb9d19a-4a64-4e54-a24f-fc3fa41a872a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 200 len: 1308 microversion: 2.1 time: 0.230401 May 13 13:59:32.360542 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 263/518] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:32 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 1308 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:32.366579 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-7f45efd9-346e-4e7c-899a-efc96f7464f8 req-04cb3b30-cab5-4cf2-9c50-653dba682369 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64d3002e-b010-4a1b-900b-ea079465a93e", "name": "network-vif-deleted", "tag": "260d78f5-565f-48bf-bc2f-22b683574971"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:32.384179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-7f45efd9-346e-4e7c-899a-efc96f7464f8 req-04cb3b30-cab5-4cf2-9c50-653dba682369 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.384621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-7f45efd9-346e-4e7c-899a-efc96f7464f8 req-04cb3b30-cab5-4cf2-9c50-653dba682369 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.402203 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-7f45efd9-346e-4e7c-899a-efc96f7464f8 req-04cb3b30-cab5-4cf2-9c50-653dba682369 service nova] Creating event network-vif-deleted:260d78f5-565f-48bf-bc2f-22b683574971 for instance 64d3002e-b010-4a1b-900b-ea079465a93e on hv-cinder-84175 May 13 13:59:32.409052 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-7f45efd9-346e-4e7c-899a-efc96f7464f8 req-04cb3b30-cab5-4cf2-9c50-653dba682369 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046067 May 13 13:59:32.410036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 264/519] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:32.874205 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:59:32.875395 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:59:32.876336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:59:32.876827 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:59:32.877364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:59:32.887293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.896336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.901103 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:32.902079 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:32.940487 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for project ef89791b177f4bf0ba916f133c79f33a. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:59:32.947707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Getting quotas for user 20fd230cc30f4980bedebc75c620d707 and project ef89791b177f4bf0ba916f133c79f33a. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:59:32.999513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:59:32.999513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:59:33.073859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-28b4e3ef-76d1-46c1-bba7-d5abb04b8f8f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.947540 May 13 13:59:33.075031 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 256/520] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:59:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1950 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:59:33.086751 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-60d4a205-8430-405a-b292-1f8ed618bf06 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:33.087937 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-60d4a205-8430-405a-b292-1f8ed618bf06 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:33.138825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:33.141059 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:33.168984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:33.169840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:33.171072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:33.171751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:33.201758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-60d4a205-8430-405a-b292-1f8ed618bf06 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.211229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-60d4a205-8430-405a-b292-1f8ed618bf06 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1245 microversion: 2.1 time: 0.129814 May 13 13:59:33.213475 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 265/521] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:33 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1245 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:33.367999 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:33.368779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 64d3002e-b010-4a1b-900b-ea079465a93e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:33.390006 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:33.390478 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:33.391295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:33.391741 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:33.437734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] HTTP exception thrown: Instance 64d3002e-b010-4a1b-900b-ea079465a93e could not be found. May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Request method failure captured: May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e HTTP/1.1 May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmPPqauzCQal8DT0LoHUeFh0cpWMAnUmf1Aw6JKMKPojmrXYdcwEeU7GoZ8LpHwQgjCFwFr7MeqlpOHhQtbCpaiqITcIwhXYWZKdY1eqZ9LVPLWdL1uFXBC3bGUnf31pliIdiuZ_d7YVXw-txoPCmixdXqL2bk8Sd8w7a5dJE2UodrU May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: a6843d24fbf2449cbd117b8d9cfc7072 May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2133506172 May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:59:33.440748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesSnapshotTestJSON-2133506172 May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: a6843d24fbf2449cbd117b8d9cfc7072 May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2133506172 May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesSnapshotTestJSON-2133506172-project May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 902bea79f26a4c1d8c3c1937f99f9d4b May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesSnapshotTestJSON-2133506172-project May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 64d3002e-b010-4a1b-900b-ea079465a93e could not be found. May 13 13:59:33.442494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '64d3002e-b010-4a1b-900b-ea079465a93e'} May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64d3002e-b010-4a1b-900b-ea079465a93e could not be found. May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:59:33.444071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64d3002e-b010-4a1b-900b-ea079465a93e could not be found. May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64d3002e-b010-4a1b-900b-ea079465a93e could not be found. May 13 13:59:33.445527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:33.448932 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Returning 404 to user: Instance 64d3002e-b010-4a1b-900b-ea079465a93e could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:59:33.451231 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-11fdc09e-a201-4043-971e-8e7a69ec783c tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e" status: 404 len: 111 microversion: 2.1 time: 0.087138 May 13 13:59:33.455104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 266/522] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:33 2022] GET /compute/v2.1/servers/64d3002e-b010-4a1b-900b-ea079465a93e => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 13:59:33.553223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.573208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.576244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:33.577981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-09dc8414-f03b-4678-8bca-03e09d9ed15d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.449648 May 13 13:59:33.590484 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 257/523] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:33 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:34.234864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:34.235922 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:34.254733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:34.255712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:34.258657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:34.265122 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:34.470544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.487376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-53e86caf-5550-4408-9cd6-dd89831b36fa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.259822 May 13 13:59:34.492969 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 267/524] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:34 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:34.615284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:34.628223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:34.654042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:34.655319 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:34.656995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:34.658259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:34.966102 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.983486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.985048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:34.986377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-71c71d41-e62b-477d-82f4-dcd183e24012 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.392642 May 13 13:59:34.986985 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 258/525] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:34 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:35.516996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:35.517563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:35.547429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:35.548073 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:35.549472 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:35.550265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:35.704968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:35.713998 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f4e5ad35-d5d4-40c7-b493-ebc9419bfe78 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.205040 May 13 13:59:35.723405 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 268/526] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:35 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:36.006520 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:36.007354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:36.015019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:36.015483 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:36.016297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:36.017060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:36.211064 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.229646 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.233895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.235334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-16fe6ef7-a938-4448-ba25-77473cc7061d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.233374 May 13 13:59:36.235982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 259/527] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:36 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:36.741145 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:36.741830 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:36.749024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:36.749655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:36.750700 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:36.751453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:36.827007 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:36.836427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-49fce714-883f-43ce-b461-b7c894d4430a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.099463 May 13 13:59:36.840105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 269/528] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:36 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:37.257866 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:37.259258 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:37.266417 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:37.267013 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:37.267802 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:37.268367 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:37.439126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.451544 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.453388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.454509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8936d4e2-84b0-48e6-bcb4-097a7f4721f8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.201833 May 13 13:59:37.455132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 260/529] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:37 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:37.861234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:37.861952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:37.869884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:37.870335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:37.871178 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:37.871607 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:37.942422 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:37.952802 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-665a75c0-2a60-43d1-b9de-3d9eb12b78e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.098527 May 13 13:59:37.955438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 270/530] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:37 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:38.481372 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:38.482526 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:38.507558 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:38.508247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:38.509651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:38.510738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:38.689182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:38.698896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:38.701545 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:38.703686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d3dbd27b-acd9-464e-b187-0c6ec6c2d0e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.231566 May 13 13:59:38.704347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 261/531] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:38 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:38.970685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:38.971345 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:38.978567 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:38.979061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:38.979840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:38.980275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:39.046026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.054075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b8ff6c53-d14e-48bd-8fa5-22bc2c66481a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.087107 May 13 13:59:39.054806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 271/532] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:38 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:39.725246 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:39.725898 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:39.732667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:39.733117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:39.733890 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:39.734325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:39.954019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.965295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.968335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:39.972429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-844fce99-878c-4dac-a5d8-64333125ab47 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.254004 May 13 13:59:39.973026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 262/533] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:39 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:40.073618 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:40.074430 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:40.082487 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:40.082899 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:40.084266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:40.084718 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:40.163767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:40.175330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0fcfa18c-e02f-4f0e-b383-68c87ad08f90 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.105837 May 13 13:59:40.178268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 272/534] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:40 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:40.997182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:40.998554 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:41.005917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:41.006744 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:41.007618 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:41.008148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:41.168983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:41.186213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:41.193806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:41.194749 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:41.197916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:41.199273 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f5e63f65-2ea6-4c41-87a5-93e767f5be46 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.209559 May 13 13:59:41.200030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 263/535] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:40 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:41.205374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:41.205945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:41.207001 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:41.207762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:41.299149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:41.308809 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fcc4a4c1-7538-45e2-96f2-f9db673f7e91 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.118463 May 13 13:59:41.309756 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 273/536] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:41 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:42.223996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:42.225162 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:42.231858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:42.232311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:42.233122 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:42.233536 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:42.326245 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:42.326930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:42.333980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:42.334427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:42.335237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:42.335699 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:42.431025 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.437665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.448919 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.449166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-afac7b59-2068-4c4c-93e5-1c3da159bcbe tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.126193 May 13 13:59:42.450579 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 274/537] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:42 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:42.451899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:42.454601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5b3b5588-354b-4539-b26f-2607e2c58498 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.234026 May 13 13:59:42.468836 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 264/538] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:42 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:43.480840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:43.482102 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:43.482290 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:43.483691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:43.488541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:43.488981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:43.490429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:43.491092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:43.494173 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:43.494951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:43.496310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:43.497094 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:43.580985 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.600543 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bca3785c-d72c-4c57-a1de-234083c057fb tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.122595 May 13 13:59:43.606501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 265/539] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:43 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:43.713437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.737212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.739698 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:43.741520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-932f52af-82a6-48bd-a5e4-6bd2d20cc316 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.266327 May 13 13:59:43.742092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 275/540] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:43 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:43.747763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-739526758", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "networks": [{"uuid": "5b41b3ab-3663-47b0-839d-04d5811870fd"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:44.625479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:44.626110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:44.633694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:44.634145 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:44.635074 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:44.635407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:44.708703 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.717816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dcdf6521-c9e3-482b-a896-544366ea00f5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.096571 May 13 13:59:44.718417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 276/541] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:44 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:44.761306 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:44.764556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:44.771762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:44.772206 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:44.774157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:44.774157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:44.958906 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.972128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.975142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:44.976808 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c999a594-f78e-40c1-be71-f65e4e272641 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.220246 May 13 13:59:44.987953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 277/542] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:44 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:45.474924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] validate_networks() for [('5b41b3ab-3663-47b0-839d-04d5811870fd', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:59:45.737815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:45.738440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:45.745231 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.745683 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.746474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.746940 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.855141 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:45.863140 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-85ea92b8-8fe1-435c-9f03-f6f8b11cb85f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1249 microversion: 2.1 time: 0.129252 May 13 13:59:45.864043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 278/543] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:45 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1249 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:45.894267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:59:45.894682 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:59:45.895517 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:59:45.896689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:59:45.897162 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:59:45.909130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.909582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.910393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:45.910870 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:45.933676 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Getting quotas for project a6843d24fbf2449cbd117b8d9cfc7072. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:59:45.945602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Getting quotas for user 902bea79f26a4c1d8c3c1937f99f9d4b and project a6843d24fbf2449cbd117b8d9cfc7072. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:59:45.961057 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:59:45.963391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:59:45.995289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:45.996020 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:46.002610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.003098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.003980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.004349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.023248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9d0074c7-e2a4-49ae-8b71-aef4821761c5 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.273084 May 13 13:59:46.023248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 266/544] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:59:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2275 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:59:46.029766 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-819cb4be-d6a9-4fbe-9581-83248330c8fd tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:46.030141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-819cb4be-d6a9-4fbe-9581-83248330c8fd tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:46.117064 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-819cb4be-d6a9-4fbe-9581-83248330c8fd tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.130735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-819cb4be-d6a9-4fbe-9581-83248330c8fd tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1218 microversion: 2.1 time: 0.104467 May 13 13:59:46.140951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 267/545] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:46 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1218 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:46.196639 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.207483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.210202 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.214030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1714d49d-6877-46d8-ab0f-0277642fdd14 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.220626 May 13 13:59:46.214030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 279/546] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:45 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:46.880401 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:46.881186 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:46.889251 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.889890 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.890936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:46.891377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:46.966589 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:46.977344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1aebe160-cf05-46d0-8c2a-7acfcf1c0aee tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1297 microversion: 2.1 time: 0.100812 May 13 13:59:46.977931 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 268/547] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:46 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1297 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:47.149678 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:47.150773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:47.157067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:47.157509 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:47.158336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:47.158945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:47.230396 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.234186 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:47.235185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:47.238858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ce1339ae-701d-46e5-b260-5344d2a3b012 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1270 microversion: 2.1 time: 0.093804 May 13 13:59:47.239444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 280/548] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:47 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:47.244478 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:47.245193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:47.246446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:47.247171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:47.440463 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.455443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.458146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:47.459968 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4780f779-ae4a-415a-8fc3-9deb6a53c7a1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.232234 May 13 13:59:47.460535 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 269/549] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:47 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:47.994572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:47.995289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:48.001775 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.002227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.003061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.003574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.145084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:48.159131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-100be828-c2de-4b6c-857f-7c7b311b8abd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1303 microversion: 2.1 time: 0.168133 May 13 13:59:48.160750 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 281/550] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:47 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1303 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:48.257648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:48.258465 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:48.265743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.266200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.267027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.267470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.416241 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:48.426432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-00599929-0992-47a5-bc6f-ca26bff9ebc7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1288 microversion: 2.1 time: 0.172929 May 13 13:59:48.428182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 270/551] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:48 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1288 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:48.485748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:48.486366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:48.493777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.494799 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.495271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:48.495707 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:48.845470 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:48.868585 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:48.874269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:48.876187 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b95d9d8a-e481-409d-a26d-9a18703c8384 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.394424 May 13 13:59:48.877053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 282/552] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:48 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:49.178200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:49.179481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:49.185496 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.186193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.187440 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.187622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.356459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:49.365438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d1cc2b25-ba1b-4eb7-89f4-bd4d36ce76de tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.190997 May 13 13:59:49.366033 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 271/553] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:49 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:49.453329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:49.457630 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:49.471146 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.471733 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.472482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.472978 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.715019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:49.725779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4414160a-3521-4897-b0b8-c4edd5fd3214 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.284015 May 13 13:59:49.727738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 283/554] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:49 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:49.738232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-943de910-b077-4070-9278-7a2da7eae387 req-98457ff2-813e-4aee-a69a-786f44a3f874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10525e5e-f295-4923-a0b4-6674a6c3f740", "tag": "882cf596-f1fe-4549-a5dc-670f7391462c"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:49.758282 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-943de910-b077-4070-9278-7a2da7eae387 req-98457ff2-813e-4aee-a69a-786f44a3f874 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.759075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-943de910-b077-4070-9278-7a2da7eae387 req-98457ff2-813e-4aee-a69a-786f44a3f874 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.778110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-943de910-b077-4070-9278-7a2da7eae387 req-98457ff2-813e-4aee-a69a-786f44a3f874 service nova] Creating event network-changed:882cf596-f1fe-4549-a5dc-670f7391462c for instance 10525e5e-f295-4923-a0b4-6674a6c3f740 on hv-cinder-84175 May 13 13:59:49.784237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-943de910-b077-4070-9278-7a2da7eae387 req-98457ff2-813e-4aee-a69a-786f44a3f874 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056146 May 13 13:59:49.785506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 272/555] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:49.895195 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:49.895870 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:49.905915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.907261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:49.908896 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:49.909850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.149130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.162118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.164536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.165791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fe328c50-341f-4dcb-b535-bd86125ddddb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.274584 May 13 13:59:50.166935 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 284/556] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:49 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:50.387713 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:50.388690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:50.398289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.399145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.400607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.401601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.415624 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-591ba860-9d5d-415f-bef4-dbfa022e6eec req-bbd34a3c-62cc-4b9e-ac05-e5711c5869f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d5dd7d1-7ac6-4694-8e6b-ad986cb70895", "tag": "d91af4b8-3bfe-4b09-8a48-fd5ef63b99b1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:50.436551 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-591ba860-9d5d-415f-bef4-dbfa022e6eec req-bbd34a3c-62cc-4b9e-ac05-e5711c5869f1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.437311 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-591ba860-9d5d-415f-bef4-dbfa022e6eec req-bbd34a3c-62cc-4b9e-ac05-e5711c5869f1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.485271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-591ba860-9d5d-415f-bef4-dbfa022e6eec req-bbd34a3c-62cc-4b9e-ac05-e5711c5869f1 service nova] Creating event network-changed:d91af4b8-3bfe-4b09-8a48-fd5ef63b99b1 for instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 on hv-cinder-84175 May 13 13:59:50.497525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-591ba860-9d5d-415f-bef4-dbfa022e6eec req-bbd34a3c-62cc-4b9e-ac05-e5711c5869f1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094692 May 13 13:59:50.498990 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 285/557] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:50.606128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:50.615477 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e36abe47-046e-4df2-98c0-e4c2a876185c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.235699 May 13 13:59:50.616074 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 273/558] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:50 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:50.747260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:50.747635 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:50.756925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.757378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:50.758320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:50.758856 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.118874 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.126629 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b712eb37-6bed-4e6a-bc13-5575bee3b2da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.385459 May 13 13:59:51.127246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 286/559] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:50 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:51.185805 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:51.186416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:51.193289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.193700 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.194497 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.196886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.338163 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.346720 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.348236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.350219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7448bead-8b26-487d-9749-e2eea36089bd tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.168890 May 13 13:59:51.350802 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 274/560] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:51 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:51.632331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:51.632945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:51.639578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.640024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.640804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:51.641238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:51.774910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:51.792937 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c54bbb85-3c18-4c52-967a-b15a6e29ecf8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.163350 May 13 13:59:51.794318 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 287/561] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:51 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:52.143289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:52.143878 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:52.157362 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.157811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.158598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.159085 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.293787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.302410 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c0f041a5-dcd4-44e8-84bb-93f8f6130785 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.162475 May 13 13:59:52.303146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 275/562] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:52 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:52.368953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:52.369595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:52.375919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.376360 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.377135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.377584 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.521891 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.530531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.532077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:52.533232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-14aab37b-a061-49d4-af40-432fca085fea tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.168751 May 13 13:59:52.533849 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 288/563] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:52 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:52.742677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2074402233", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-323121193", "security_groups": [{"name": "tempest-secgroup-smoke-1743970202"}], "block_device_mapping_v2": [{"uuid": "6af80944-6ebe-4508-94fa-1f697e2dddad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03a70c19-db79-42a5-9674-8042863a7bc5"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:52.812736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:52.813453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:52.820116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.820670 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.821561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:52.822125 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:52.875196 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] validate_networks() for [('03a70c19-db79-42a5-9674-8042863a7bc5', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 13:59:53.054123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.062299 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f258036c-6db3-4ffc-aaf7-2ddc17fee016 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.253628 May 13 13:59:53.062918 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 289/564] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:52 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:53.319142 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 13:59:53.320100 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 13:59:53.320613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:53.320947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 13:59:53.321429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:53.321865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 13:59:53.322528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 13:59:53.330351 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.330829 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.331627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.332249 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.335622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.336086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.336926 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.342138 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.357386 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 13:59:53.361213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for user a27e83f9f5fb4a0b99e7fac6ab90b3e4 and project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 13:59:53.423909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 13:59:53.426444 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6af80944-6ebe-4508-94fa-1f697e2dddad',volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 13:59:53.510252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.518458 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-58fb6c4c-2e9f-433d-8493-68ee26d1ef0f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.203272 May 13 13:59:53.519104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 290/565] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:53 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:53.558211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:53.559249 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:53.573610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.573610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.573610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:53.573610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:53.603030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c4e70b17-fa43-4983-8c3f-ee9e811968fb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.865458 May 13 13:59:53.603903 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 276/566] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 13:59:52 2022] POST /compute/v2.1/servers => generated 406 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 13:59:53.616003 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f2686967-cf96-4162-adb0-92e0467f32e6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:53.616630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f2686967-cf96-4162-adb0-92e0467f32e6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:53.712725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f2686967-cf96-4162-adb0-92e0467f32e6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.719442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f2686967-cf96-4162-adb0-92e0467f32e6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1094 microversion: 2.1 time: 0.107850 May 13 13:59:53.720028 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 277/567] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:53 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1094 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:53.858428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.868498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.870599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:53.872082 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1b445fb0-7244-4aad-8dd8-b05affbc3f2c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.319332 May 13 13:59:53.872859 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 291/568] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:53 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:54.079611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.080233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.086896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.087342 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.088470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.088909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.238757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:54.250140 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a471d959-aa9e-43a8-8e0b-02d89ea4d6f1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.174418 May 13 13:59:54.250749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 278/569] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:54.536600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.537259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.543958 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.544366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.545157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.545597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.726503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:54.734610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f0bf39dc-1055-43c8-beea-3de11ad91b11 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.202489 May 13 13:59:54.735233 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 292/570] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:54.738624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.739311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.746026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.746506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.747451 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.747898 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.816622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:54.826834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-11566f42-53c4-4986-9b83-75f80ff943db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1144 microversion: 2.1 time: 0.092701 May 13 13:59:54.827798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 279/571] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1144 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:54.892991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:54.893599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:54.900321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.900759 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:54.901526 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:54.901954 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.044079 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.053264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.054787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.055970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0539e8c9-bbb0-44de-82e4-20df575c01f5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.168262 May 13 13:59:55.056537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 293/572] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:54 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:55.274725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:55.275819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:55.309447 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.310243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.312047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.312837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.476327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.486672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-567e34bf-8f35-4469-be39-efccc7d12a40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.219416 May 13 13:59:55.487570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 280/573] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:55 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:55.652655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-1acb9a9d-397d-45d8-bba2-309562458a47 req-44677b8e-319a-4a27-9a3a-9af06d953471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5dd7d1-7ac6-4694-8e6b-ad986cb70895", "name": "network-vif-plugged", "status": "completed", "tag": "d91af4b8-3bfe-4b09-8a48-fd5ef63b99b1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:55.662632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-1acb9a9d-397d-45d8-bba2-309562458a47 req-44677b8e-319a-4a27-9a3a-9af06d953471 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.663307 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-1acb9a9d-397d-45d8-bba2-309562458a47 req-44677b8e-319a-4a27-9a3a-9af06d953471 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.676388 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-1acb9a9d-397d-45d8-bba2-309562458a47 req-44677b8e-319a-4a27-9a3a-9af06d953471 service nova] Creating event network-vif-plugged:d91af4b8-3bfe-4b09-8a48-fd5ef63b99b1 for instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 on hv-cinder-84175 May 13 13:59:55.682133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-1acb9a9d-397d-45d8-bba2-309562458a47 req-44677b8e-319a-4a27-9a3a-9af06d953471 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033172 May 13 13:59:55.682805 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 294/574] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:59:55.757243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:55.757954 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:55.764709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.765269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.766292 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.766684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.845670 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:55.846371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:55.853421 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.853902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.854690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:55.855152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:55.933270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.940390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:55.941258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-444806d6-5908-4ae8-9fc5-56045e728e03 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1192 microversion: 2.1 time: 0.099874 May 13 13:59:55.942145 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 295/575] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:55 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1192 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:55.953884 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-74b21a63-d56c-4987-8737-acc14a9e042d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.202626 May 13 13:59:55.954563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 281/576] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:55 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:56.073953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:56.074787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:56.081380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.081852 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.082642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.083612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.297923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.308966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.310467 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.311682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-46b243ce-45b9-4146-903f-082862f8a401 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.242100 May 13 13:59:56.312262 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 296/577] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:56 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:56.505845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:56.506465 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:56.513305 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.513762 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.514661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.515184 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.661305 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:56.669269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9fb735eb-d891-435a-b9a2-6fa462a9923e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.167733 May 13 13:59:56.669847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 282/578] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:56 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:56.959142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:56.959853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:56.966535 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.967024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.967823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.968261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.977204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:56.978807 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:56.985130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.985585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:56.986567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:56.987159 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.066531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.076402 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a2749bac-92b6-43e5-90b0-356ca783fa79 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1210 microversion: 2.1 time: 0.119987 May 13 13:59:57.085193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 297/579] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:56 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1210 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:57.155497 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.165965 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1479fb40-c27a-4026-a76a-ae511914a789 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1318 microversion: 2.1 time: 0.192707 May 13 13:59:57.166560 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 283/580] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:56 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:57.344033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:57.344732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:57.352759 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.353911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.355565 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.356226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.550934 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.565366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.573179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.574681 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-432959b8-623b-4e1b-bd0f-e40883d2dbe5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.234632 May 13 13:59:57.575469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 298/581] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:57 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 13:59:57.688588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:57.689282 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:57.702672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.703549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.704353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.704796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.717504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-09de4a27-4e82-400e-bf1c-8cdb91410f90 req-4a12cb63-7ab7-4165-8b95-948fa175485d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "name": "network-vif-plugged", "status": "completed", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:57.726540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-09de4a27-4e82-400e-bf1c-8cdb91410f90 req-4a12cb63-7ab7-4165-8b95-948fa175485d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:57.727255 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-09de4a27-4e82-400e-bf1c-8cdb91410f90 req-4a12cb63-7ab7-4165-8b95-948fa175485d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:57.739961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-09de4a27-4e82-400e-bf1c-8cdb91410f90 req-4a12cb63-7ab7-4165-8b95-948fa175485d service nova] Creating event network-vif-plugged:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 13:59:57.745861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-09de4a27-4e82-400e-bf1c-8cdb91410f90 req-4a12cb63-7ab7-4165-8b95-948fa175485d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032590 May 13 13:59:57.746459 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 299/582] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:59:57.851710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:57.861816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4f56d83e-3258-4ee6-bb5f-b089da64d29b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.177621 May 13 13:59:57.862518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 284/583] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:57 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:58.079010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-7c39187a-2eb1-473c-a0d1-7e4df2659bde req-03517ada-31db-4b60-8e97-edfb580959ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af879bc4-815b-4dc1-ad35-0b280ad94c3a", "tag": "2a100cb6-7cc3-4a92-bd93-e27c28acc92a"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:58.091723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.092355 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.096829 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-7c39187a-2eb1-473c-a0d1-7e4df2659bde req-03517ada-31db-4b60-8e97-edfb580959ff service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.100990 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.101678 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.102485 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.102959 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.104378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-7c39187a-2eb1-473c-a0d1-7e4df2659bde req-03517ada-31db-4b60-8e97-edfb580959ff service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.124448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-7c39187a-2eb1-473c-a0d1-7e4df2659bde req-03517ada-31db-4b60-8e97-edfb580959ff service nova] Creating event network-changed:2a100cb6-7cc3-4a92-bd93-e27c28acc92a for instance af879bc4-815b-4dc1-ad35-0b280ad94c3a on hv-cinder-84175 May 13 13:59:58.129240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-7c39187a-2eb1-473c-a0d1-7e4df2659bde req-03517ada-31db-4b60-8e97-edfb580959ff service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058064 May 13 13:59:58.130045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 300/584] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 13:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 13:59:58.188992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.188992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.192119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.192218 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.192990 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.193400 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.299447 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.309117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c9b0d10c-3cec-4c21-8109-87e824f82311 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.220991 May 13 13:59:58.309547 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 285/585] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:58.366342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.375525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7ebb1828-6e32-46d5-9f20-0f629e67de1d tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1507 microversion: 2.1 time: 0.195708 May 13 13:59:58.376121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 301/586] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1507 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:58.393521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "74b8bc2f-e5fd-445e-a31b-13d71673d0ce", "device": "/dev/sdb"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:58.395726 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.402047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.402499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.403308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.403747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.593710 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.594229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.601587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.601762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.603307 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.603876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.760288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.769273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.770862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:58.772053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3e910162-9bfa-450f-b8b7-8c5d336e0a1b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.182328 May 13 13:59:58.772619 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 302/587] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 13:59:58.885696 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:58.886216 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:58.892758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.893207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:58.893986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:58.894421 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.043061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.050738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-82a9c209-c26b-4684-a03f-27cb1ab2c1b0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.169002 May 13 13:59:59.052050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 303/588] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:58 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 13:59:59.065965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.066457 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.073463 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.073911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.074695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.075157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.100264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a73f7789-b65d-45c3-8cba-94d93c7db1d7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/ips" status: 200 len: 150 microversion: 2.1 time: 0.038143 May 13 13:59:59.100947 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 304/589] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:59:59.111746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9496dec8-c8ae-4228-88ef-6042309b3414"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 13:59:59.112900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.119775 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.120222 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.120997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.121429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.211751 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Invalid volume: volume 9496dec8-c8ae-4228-88ef-6042309b3414 is already attached to instances: c5fb9024-5080-4527-b9ac-55f60dbccd8a May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: POST /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/os-volume_attachments HTTP/1.1 May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 74 May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 13:59:59.213508 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {"volumeAttachment": {"volumeId": "9496dec8-c8ae-4228-88ef-6042309b3414"}} May 13 13:59:59.216227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Invalid volume: volume 9496dec8-c8ae-4228-88ef-6042309b3414 is already attached to instances: c5fb9024-5080-4527-b9ac-55f60dbccd8a May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'server_id': '1309a28e-544d-4d0d-a42e-4a5be1b1ddb6', 'body': {'volumeAttachment': {'volumeId': '9496dec8-c8ae-4228-88ef-6042309b3414'}}} May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9496dec8-c8ae-4228-88ef-6042309b3414 is already attached to instances: c5fb9024-5080-4527-b9ac-55f60dbccd8a May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:59.217691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9496dec8-c8ae-4228-88ef-6042309b3414 is already attached to instances: c5fb9024-5080-4527-b9ac-55f60dbccd8a May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 13:59:59.219774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9496dec8-c8ae-4228-88ef-6042309b3414 is already attached to instances: c5fb9024-5080-4527-b9ac-55f60dbccd8a May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 400 to user: Invalid volume: volume 9496dec8-c8ae-4228-88ef-6042309b3414 is already attached to instances: c5fb9024-5080-4527-b9ac-55f60dbccd8a {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e711eed2-c8ce-4247-b9ef-70613724b72b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108079 May 13 13:59:59.222247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 305/590] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:59:59 2022] POST /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 13 13:59:59.227599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.228300 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.235632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.236112 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.236947 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.237383 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.265851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 13:59:59.379156 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2feaa2db-2c8f-4d8c-9ad8-85dfdeef604b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 204 len: 0 microversion: 2.1 time: 0.156443 May 13 13:59:59.380600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 306/591] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 13:59:59 2022] DELETE /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 13:59:59.397909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.400518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.410044 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.411512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.412479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.413271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.479949 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ca5f98d5-faf4-4c1b-8104-a406dfbbdd78 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "POST /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.090333 May 13 13:59:59.480775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 286/592] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 13:59:58 2022] POST /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895/os-volume_attachments => generated 194 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 13:59:59.486347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.487194 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.495563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.496104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.497054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.497567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.632131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.643225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d431f549-e8d0-46b9-a99d-e06f90dc9675 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.260438 May 13 13:59:59.644356 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 307/593] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:59.700234 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.708145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a04239fb-d475-4413-bf80-5c9021c92884 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1682 microversion: 2.1 time: 0.225885 May 13 13:59:59.708729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 287/594] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 13:59:59.791611 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 13:59:59.792338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 13:59:59.800033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.800759 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.801560 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 13:59:59.802185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 13:59:59.965634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.974978 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.976503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 13:59:59.977696 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-55253ac7-3a0b-48bb-84e4-ec4f6b738702 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.190793 May 13 13:59:59.978468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 308/595] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 13:59:59 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:00.068547 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.069149 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:00.075881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.076329 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.077111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.077542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.247221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:00.256393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c002b80a-a180-41bd-828b-18dc274b9bfa tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.191610 May 13 14:00:00.256982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 288/596] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:00.664761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.665371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:00.671886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.672341 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.673119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.673558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.731850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.732614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:00.740392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.740925 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.741880 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:00.742374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:00.861915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:00.871115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-05c5e28f-fadf-4214-8173-ac1789f1a9b4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.210149 May 13 14:00:00.871854 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 309/597] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:00.910853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:00.922587 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a55cdef7-8ba0-4d31-9598-00e3a945850d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1682 microversion: 2.1 time: 0.194223 May 13 14:00:00.923444 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 289/598] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:00.997062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:00.997702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:01.005773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.006349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.007061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.007501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.183120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.192120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.193641 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.195929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cf8fe6f2-b3f1-4750-aa30-112002826abc tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.201777 May 13 14:00:01.195929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 310/599] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:00:00 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:01.274544 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:01.275204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:01.282470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.282960 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.283760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.284207 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.456130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:01.470126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7cd940ee-54f8-45bf-ada2-db9504840788 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.199885 May 13 14:00:01.471084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 290/600] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:01 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:01.623598 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-16b9fde5-89c6-48b6-bca6-12014824efb5 req-1ea3276e-1ed8-4a5d-96a3-54390b8b2956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10525e5e-f295-4923-a0b4-6674a6c3f740", "name": "network-vif-plugged", "status": "completed", "tag": "882cf596-f1fe-4549-a5dc-670f7391462c"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:01.634261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-16b9fde5-89c6-48b6-bca6-12014824efb5 req-1ea3276e-1ed8-4a5d-96a3-54390b8b2956 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.634911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-16b9fde5-89c6-48b6-bca6-12014824efb5 req-1ea3276e-1ed8-4a5d-96a3-54390b8b2956 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.655545 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-16b9fde5-89c6-48b6-bca6-12014824efb5 req-1ea3276e-1ed8-4a5d-96a3-54390b8b2956 service nova] Creating event network-vif-plugged:882cf596-f1fe-4549-a5dc-670f7391462c for instance 10525e5e-f295-4923-a0b4-6674a6c3f740 on hv-cinder-84175 May 13 14:00:01.661480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-16b9fde5-89c6-48b6-bca6-12014824efb5 req-1ea3276e-1ed8-4a5d-96a3-54390b8b2956 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042948 May 13 14:00:01.662616 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 311/601] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:01.888838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:01.889635 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:01.896907 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.897366 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.898160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.898631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.946858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:01.948019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:01.966520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.966520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:01.966520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:01.966520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.107913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.116704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c63e8742-5a36-4830-aa9e-f2b5dc8533c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.231859 May 13 14:00:02.117506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 291/602] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:01 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:02.136398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.144039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4b2aac34-fdbc-405d-8636-6f6c5d05587f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1682 microversion: 2.1 time: 0.206498 May 13 14:00:02.144480 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 312/603] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:01 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:02.216825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:02.217859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:02.224622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:02.225069 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.225843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:02.226278 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.360793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.370358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.371910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.373112 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b5c00e1d-1116-4345-a101-ad580144abb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.163178 May 13 14:00:02.373673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 292/604] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:00:02 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:02.496098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:02.497156 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:02.508384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:02.510266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.516738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:02.518814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:02.832837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:02.847797 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c0ea55d0-2e9d-440a-91b5-a24d96408ede tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.355799 May 13 14:00:02.848443 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 313/605] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:02 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:03.137964 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.139847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.148235 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.148687 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.149489 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.149952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.166395 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.167523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.199401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.199849 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.200635 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.201448 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.704791 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.726242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:03.726495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-365fce20-bb55-45d4-9cfb-8a7e0380d9c4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.590904 May 13 14:00:03.728754 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 293/606] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:03.737747 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bb26ba33-eddc-4bc0-840c-2b4998ce0682 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1682 microversion: 2.1 time: 0.578376 May 13 14:00:03.738440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 314/607] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1682 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:03.741561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.742928 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.757134 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.757657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.758694 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.759255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.867043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:03.868256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:03.877295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.878260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:03.879664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:03.880891 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.035294 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.052655 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.056696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.058305 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7c94c83b-398a-4a4e-a82a-6b72cf43afb8 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1809 microversion: 2.20 time: 0.327822 May 13 14:00:04.059450 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 294/608] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1809 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:00:04.108304 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.117273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c1974b65-cc0a-443f-8860-29a11c5588d8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.255695 May 13 14:00:04.117864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 315/609] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:03 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:04.180245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-14737e90-9c6d-45a6-8a4b-8ab182bc328e req-8546fdc8-625e-4eb6-9476-400e9e169567 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1309a28e-544d-4d0d-a42e-4a5be1b1ddb6", "name": "network-vif-deleted", "tag": "88a82195-7c42-46b1-8e8d-08caa5d38af4"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:04.189770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-14737e90-9c6d-45a6-8a4b-8ab182bc328e req-8546fdc8-625e-4eb6-9476-400e9e169567 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.190219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-14737e90-9c6d-45a6-8a4b-8ab182bc328e req-8546fdc8-625e-4eb6-9476-400e9e169567 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.203399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-14737e90-9c6d-45a6-8a4b-8ab182bc328e req-8546fdc8-625e-4eb6-9476-400e9e169567 service nova] Creating event network-vif-deleted:88a82195-7c42-46b1-8e8d-08caa5d38af4 for instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 on hv-cinder-84175 May 13 14:00:04.210423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-14737e90-9c6d-45a6-8a4b-8ab182bc328e req-8546fdc8-625e-4eb6-9476-400e9e169567 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034865 May 13 14:00:04.211068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 295/610] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:04.747301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:04.747301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:04.757600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:04.758320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:04.762694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.763788 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.766595 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.766791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.767188 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.767382 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.768439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:04.769044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:04.853687 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:04.864518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3c31f009-d08d-460c-833c-c414408e34d0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1327 microversion: 2.1 time: 0.112075 May 13 14:00:04.865619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 296/611] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:04 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1327 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:05.039661 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.066251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ee7ad56d-ff16-446f-aa13-c49da2f35223 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.323561 May 13 14:00:05.075593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 316/612] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:04 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:05.079128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:05.080326 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:05.087986 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.088438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.089238 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.089763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.141282 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:05.141901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:05.149629 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.150389 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.151400 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.152010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.316754 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.326698 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.328674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.330235 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3cd9554f-ba03-4bbd-9469-34473189adb2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1796 microversion: 2.20 time: 0.256855 May 13 14:00:05.331676 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 297/613] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:00:05 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1796 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:00:05.348542 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:05.357387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e179f3cc-e67d-4353-8f25-d4ddc6a27db9 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1371 microversion: 2.1 time: 0.219930 May 13 14:00:05.358219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 317/614] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:05 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:05.887582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:05.888111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:05.894303 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.894784 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.895622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.896073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.935452 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:05.936049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:05.936601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'fault' on Instance uuid 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:06.001263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.009679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-574a5151-8906-443a-8289-354fbcd48ff1 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 200 len: 1332 microversion: 2.1 time: 0.126000 May 13 14:00:06.010254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 298/615] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:05 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:06.096381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:06.097854 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:06.107980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.108719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.109984 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.110758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.266660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.275826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-114fa3ef-8134-4347-b136-f271dd8bc0de tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.186570 May 13 14:00:06.276405 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 318/616] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:06 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:06.379169 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:06.380026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:06.392598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.393049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.393874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.394322 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.619998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:06.629848 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b1449161-0004-4234-904d-6376103ed1c6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1566 microversion: 2.1 time: 0.255521 May 13 14:00:06.631280 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 299/617] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:06 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1566 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:06.649729 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:06.650557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:06.658003 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.658777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.659735 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:06.660420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:06.770157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-382c9b61-3056-4650-b866-9aa2507d0bc8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.124884 May 13 14:00:06.773372 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 319/618] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 14:00:06 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:07.026984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:07.027523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:07.034121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.034681 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.035384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.035822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.051435 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 HTTP/1.1 May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:00:07.053887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:00:07.056340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '1309a28e-544d-4d0d-a42e-4a5be1b1ddb6'} May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:07.057643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:00:07.061178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:07.064476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:07.064476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-521922cf-5eab-4def-812c-66cb92b4fc2b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 404 len: 111 microversion: 2.1 time: 0.032238 May 13 14:00:07.064476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 300/619] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:07 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:00:07.064924 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d7dde722-b970-4b4d-a670-f721f5d0fd3e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '.version_select at 0x7fb3bddbb700>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:07.090397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d7dde722-b970-4b4d-a670-f721f5d0fd3e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069255686" status: 202 len: 0 microversion: 2.1 time: 0.029506 May 13 14:00:07.090866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 320/620] 10.222.0.79 () {58 vars in 1220 bytes} [Fri May 13 14:00:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2069255686 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:00:07.299129 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:07.300616 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:07.312754 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.313523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.314509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:07.315156 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:07.702910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:07.711611 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0751bb90-02a9-4168-8e0e-05682ce61309 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.416726 May 13 14:00:07.712593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 301/621] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:07 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:08.085672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-3b922956-96f8-4e47-99b4-84a823728258 req-853fd8a1-7af7-431f-a664-422f3ea4483d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10525e5e-f295-4923-a0b4-6674a6c3f740", "tag": "882cf596-f1fe-4549-a5dc-670f7391462c"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:08.100213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-3b922956-96f8-4e47-99b4-84a823728258 req-853fd8a1-7af7-431f-a664-422f3ea4483d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.100763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-3b922956-96f8-4e47-99b4-84a823728258 req-853fd8a1-7af7-431f-a664-422f3ea4483d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.114206 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-3b922956-96f8-4e47-99b4-84a823728258 req-853fd8a1-7af7-431f-a664-422f3ea4483d service nova] Creating event network-changed:882cf596-f1fe-4549-a5dc-670f7391462c for instance 10525e5e-f295-4923-a0b4-6674a6c3f740 on hv-cinder-84175 May 13 14:00:08.120548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-3b922956-96f8-4e47-99b4-84a823728258 req-853fd8a1-7af7-431f-a664-422f3ea4483d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039787 May 13 14:00:08.124334 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 321/622] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:00:08.162959 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:08.163872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:08.171594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.172382 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.173545 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.174153 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.334005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'services' on Instance uuid c5fb9024-5080-4527-b9ac-55f60dbccd8a {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:08.471098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3193aefc-e201-4153-8671-f360d47c1b3d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments/9496dec8-c8ae-4228-88ef-6042309b3414" status: 202 len: 0 microversion: 2.1 time: 0.313577 May 13 14:00:08.472164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 302/623] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:00:08 2022] DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments/9496dec8-c8ae-4228-88ef-6042309b3414 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:00:08.484159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:08.485308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:08.493171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.493726 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.494930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.495351 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.529469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c443728e-334e-4782-8fc7-3aed277c5591 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050599 May 13 14:00:08.530061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 322/624] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:08 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:08.729538 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:08.730857 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:08.738049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.738499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.739324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:08.739758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:08.946000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:08.958558 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-686b273c-0a51-4334-9d51-5248b5bf50cc tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.232449 May 13 14:00:08.959891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 303/625] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:08 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:09.542237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:09.543834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:09.551763 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.552224 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.553059 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.553521 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.589394 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-68bea4be-7a20-4650-9c31-a7d602f41c37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052191 May 13 14:00:09.590005 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 323/626] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:09 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:09.981082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:09.981750 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:09.988794 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.990019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:09.990918 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:09.991362 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.140296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:10.149114 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-47ad3d07-6219-4125-9fed-632609863026 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.174463 May 13 14:00:10.149719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 304/627] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:09 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:10.602166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:10.603153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:10.609757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.610119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.610954 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:10.611401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:10.648607 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-934f72f3-c681-4639-a9d6-9c2b1afb0749 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050871 May 13 14:00:10.649189 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 324/628] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:10 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:11.165803 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:11.166454 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:11.176457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.177415 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.178200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.178638 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.319421 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:11.327317 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a58486a7-59e1-4e2d-b01d-aa3cf7019449 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.165405 May 13 14:00:11.327888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 305/629] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:11 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:11.660777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:11.662294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:11.669331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.669782 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.670575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:11.671125 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:11.704709 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2044b4ec-5579-48a9-9c32-b016be7de413 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048182 May 13 14:00:11.705301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 325/630] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:11 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:12.344766 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:12.345382 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:12.352236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.352692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.353482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.353933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.500896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:12.509237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-812b9541-5d55-4271-8f32-93419744d44f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.168345 May 13 14:00:12.509824 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 306/631] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:12 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:12.718119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:12.719136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:12.725902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.726360 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.727247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:12.727694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:12.760086 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-246f7ff1-c34b-4720-aee0-28bc46194619 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 May 13 14:00:12.760666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 326/632] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:12 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:13.526173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:13.527040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:13.533548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.534008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.534825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.535265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.703463 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:13.711432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1e4c9e3e-edd0-4c31-a690-0d680e1f2d78 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.189153 May 13 14:00:13.712000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 307/633] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:13 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:13.772142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:13.773082 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:13.779816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.780176 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.780948 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:13.781378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:13.814064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-11494e3f-ec48-41ca-bdb2-ad43f1efa975 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045888 May 13 14:00:13.814651 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 327/634] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:13 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:14.733218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:14.733972 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:14.740599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.741801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.742645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.743110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.826628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:14.827622 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:14.836939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.837647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.838918 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:14.839714 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:14.894428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bf0e44f3-f05a-4304-9db9-6c1b925394be tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071423 May 13 14:00:14.895741 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 328/635] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:14 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:14.927302 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:14.936695 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-26cb425b-2c94-431a-8299-d7305e718d91 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.210259 May 13 14:00:14.937273 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 308/636] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:14 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:15.908808 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:15.909849 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:15.917025 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.917473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.918265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.918695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.950212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-311e43c5-ea6c-4da2-a64f-43e9e50fa25c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045853 May 13 14:00:15.950850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 329/637] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:00:15 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:00:15.958014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:15.960219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:15.972695 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.973125 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:15.974572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:15.975808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.012772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:16.013281 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:16.020677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.021164 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.022625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.023179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.054789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:00:16.137855 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:16.147937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-eeb263cf-f484-4de8-9649-e0294af02ba3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.196196 May 13 14:00:16.148571 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 309/638] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:15 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:16.152755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-605ebff6-aee4-42aa-bad2-7bf80f1dca96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 204 len: 0 microversion: 2.1 time: 0.144066 May 13 14:00:16.154060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 330/639] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:00:16 2022] DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 14:00:16.163600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:16.164569 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:16.170904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.171355 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.172139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:16.172575 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:16.321439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:16.331451 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bfef4afc-9075-4f0e-8414-6523faff1ae7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1681 microversion: 2.1 time: 0.172683 May 13 14:00:16.332043 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 310/640] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:16 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:17.166571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:17.167338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:17.174115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:17.175079 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:17.175655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:17.176105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:17.328467 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:17.336840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ddc88415-886d-46a5-a311-b4323f54393e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.175227 May 13 14:00:17.337431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 331/641] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:17 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:17.350182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:17.350858 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:17.357641 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:17.358904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:17.359081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:17.359514 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:17.504872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:17.512632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-28a40366-d32d-404f-8358-e5e56172a42b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1681 microversion: 2.1 time: 0.166548 May 13 14:00:17.513209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 311/642] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:17 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:18.354946 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:18.355512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:18.362225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.362669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.363546 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.364018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.516501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:18.526754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5df0cc3d-b215-421e-bd49-57e3bd9c5b8b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.176679 May 13 14:00:18.527740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 332/643] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:18 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:18.529993 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:18.530603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:18.537200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.537876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.538408 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:18.538865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:18.686088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:18.697692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-01f88500-09b1-4cb6-b43d-f12d1933cc55 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1681 microversion: 2.1 time: 0.171303 May 13 14:00:18.698554 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 312/644] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:18 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:19.001091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:19.001691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:19.008045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.008502 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.009289 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.009758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.098595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lazy-loading 'services' on Instance uuid 596ea3e4-5857-40b2-82e2-84c63e19f7da {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:19.185672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-df9e9bef-8acd-4b3a-843f-dd06317c8211 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-volume_attachments/6c3ea828-1b77-4ba4-86fa-e197a10f1d77" status: 202 len: 0 microversion: 2.1 time: 0.188709 May 13 14:00:19.186270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 333/645] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:00:18 2022] DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-volume_attachments/6c3ea828-1b77-4ba4-86fa-e197a10f1d77 => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:19.544752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:19.545571 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:19.552471 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.552950 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.553758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.554193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.704489 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:19.714822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1c0459e5-39dd-40d6-b6d8-9d336c20edbf tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.173941 May 13 14:00:19.715421 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 313/646] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:19 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:19.719381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:19.720181 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:19.727336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.727783 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.728636 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:19.729141 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:19.868379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:19.876439 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c8556f70-0c94-459f-b2b2-b2ccb23adc77 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1681 microversion: 2.1 time: 0.161881 May 13 14:00:19.877027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 334/647] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:19 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:20.343085 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-638e86b6-432d-4930-8244-320a665e07e2 req-a8679e37-6fb3-4d9d-a4ae-cdc019ca167e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af879bc4-815b-4dc1-ad35-0b280ad94c3a", "name": "network-vif-plugged", "status": "completed", "tag": "2a100cb6-7cc3-4a92-bd93-e27c28acc92a"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:20.352499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-638e86b6-432d-4930-8244-320a665e07e2 req-a8679e37-6fb3-4d9d-a4ae-cdc019ca167e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.352904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-638e86b6-432d-4930-8244-320a665e07e2 req-a8679e37-6fb3-4d9d-a4ae-cdc019ca167e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.366491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-638e86b6-432d-4930-8244-320a665e07e2 req-a8679e37-6fb3-4d9d-a4ae-cdc019ca167e service nova] Creating event network-vif-plugged:2a100cb6-7cc3-4a92-bd93-e27c28acc92a for instance af879bc4-815b-4dc1-ad35-0b280ad94c3a on hv-cinder-84175 May 13 14:00:20.372385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-638e86b6-432d-4930-8244-320a665e07e2 req-a8679e37-6fb3-4d9d-a4ae-cdc019ca167e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 May 13 14:00:20.373632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 314/648] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:20.734998 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:20.735883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:20.742681 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.743459 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.744263 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.744706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.901778 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:20.903848 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:20.905125 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:20.911915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-58843598-0770-4d4e-929d-ed286033a760 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.181780 May 13 14:00:20.914444 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.914953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.915765 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:20.916210 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:20.922054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 335/649] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:20 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:21.058040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:21.066075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dfef6444-8c71-4066-b087-5187053db8dc tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1681 microversion: 2.1 time: 0.170973 May 13 14:00:21.066654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 315/650] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:20 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:21.933930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:21.935560 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:21.947248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:21.947971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:21.949331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:21.950136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:22.083531 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:22.084744 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:22.092317 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:22.092920 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:22.093722 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:22.094158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:22.426423 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:22.434963 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-09709ee6-af3c-4a9d-b72a-10f010376fa8 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.508543 May 13 14:00:22.435679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 336/651] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:21 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:22.440743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:22.441507 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:22.449042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:22.449697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:22.450679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:22.451025 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:22.451170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:22.460711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dc500cad-ee0d-43fd-a1d2-f6260a963d4c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1681 microversion: 2.1 time: 0.381005 May 13 14:00:22.461275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 316/652] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:22 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1681 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:22.577313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lazy-loading 'services' on Instance uuid 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:22.700265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4714909a-4e3b-45de-8c15-2a920788bfc0 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895/os-volume_attachments/74b8bc2f-e5fd-445e-a31b-13d71673d0ce" status: 202 len: 0 microversion: 2.1 time: 0.263213 May 13 14:00:22.700929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 337/653] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:00:22 2022] DELETE /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895/os-volume_attachments/74b8bc2f-e5fd-445e-a31b-13d71673d0ce => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:22.976992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-fbb4a8b8-17f6-43b5-8c81-6b4e4110f9cc req-e0942338-db01-4ab9-a231-c4cd76cc63ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5fb9024-5080-4527-b9ac-55f60dbccd8a", "name": "network-vif-deleted", "tag": "504a7fcd-a3fa-4e91-ae56-90416b5e697f"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:22.987311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-fbb4a8b8-17f6-43b5-8c81-6b4e4110f9cc req-e0942338-db01-4ab9-a231-c4cd76cc63ab service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:22.987836 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-fbb4a8b8-17f6-43b5-8c81-6b4e4110f9cc req-e0942338-db01-4ab9-a231-c4cd76cc63ab service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.019707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-fbb4a8b8-17f6-43b5-8c81-6b4e4110f9cc req-e0942338-db01-4ab9-a231-c4cd76cc63ab service nova] Creating event network-vif-deleted:504a7fcd-a3fa-4e91-ae56-90416b5e697f for instance c5fb9024-5080-4527-b9ac-55f60dbccd8a on hv-cinder-84175 May 13 14:00:23.025616 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-fbb4a8b8-17f6-43b5-8c81-6b4e4110f9cc req-e0942338-db01-4ab9-a231-c4cd76cc63ab service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053993 May 13 14:00:23.026218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 317/654] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:23.457344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:23.458300 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:23.465796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.466284 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.467108 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.467729 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.481788 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:23.483205 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:23.492370 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.492839 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.493603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.494053 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.537332 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.537732 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.539320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'fault' on Instance uuid c5fb9024-5080-4527-b9ac-55f60dbccd8a {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:23.603164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:23.612546 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-199a4be2-2ad9-4244-9c9b-b3fd682dbc96 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1331 microversion: 2.1 time: 0.135068 May 13 14:00:23.613620 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 318/655] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:23 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1331 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:23.620214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3ce8c3cc-8758-44f0-a9cb-e631a9ed2a22 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:23.627741 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce8c3cc-8758-44f0-a9cb-e631a9ed2a22 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.628190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce8c3cc-8758-44f0-a9cb-e631a9ed2a22 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.671718 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:23.679823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6da26b82-7a26-441f-bc4b-fda0ceba6fe9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1266 microversion: 2.1 time: 0.226804 May 13 14:00:23.680416 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 338/656] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:23 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1266 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:23.700462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3ce8c3cc-8758-44f0-a9cb-e631a9ed2a22 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Going to try to stop instance {{(pid=123511) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 14:00:23.748300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3ce8c3cc-8758-44f0-a9cb-e631a9ed2a22 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action" status: 202 len: 0 microversion: 2.1 time: 0.132900 May 13 14:00:23.748920 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 319/657] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:00:23 2022] POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:23.758067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:23.758701 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:23.765674 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.766120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.767722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:23.768419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:23.927274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:23.936473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5adbf9b3-0bb4-4f08-b608-f1d4bbc7d517 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.183076 May 13 14:00:23.937075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 339/658] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:23 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:24.634457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:24.635321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:24.642324 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.642800 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.643599 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.644034 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.681146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.681708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.682167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'fault' on Instance uuid c5fb9024-5080-4527-b9ac-55f60dbccd8a {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:00:24.697738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:24.699085 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:24.706815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.707534 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.709374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.710299 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.734978 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:24.745854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e981c3a6-dbf9-4b71-aa72-38473e25d35e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 200 len: 1331 microversion: 2.1 time: 0.116002 May 13 14:00:24.746450 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 320/659] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:24 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 1331 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:24.874613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:24.888178 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-370e876a-c656-45b8-9987-08250bece4f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1453 microversion: 2.1 time: 0.194919 May 13 14:00:24.888956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 340/660] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:24 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:24.905819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:24.906446 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:24.912923 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.913354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.914159 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.914612 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.957950 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:24.959346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:24.966079 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.966537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:24.967375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:24.967820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:25.111550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:25.119603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2ebcdafe-1207-4a1b-9271-bde84f5c1d1f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1453 microversion: 2.1 time: 0.218064 May 13 14:00:25.120199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 321/661] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:24 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1453 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:25.162968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:25.172326 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a9beb8a2-6f91-473d-a7a5-db174201055b tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.219751 May 13 14:00:25.172914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 341/662] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:24 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:25.767974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:25.768752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:25.777553 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:25.778130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:25.779176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:25.779796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:25.813862 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a HTTP/1.1 May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:00:25.818549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:00:25.821423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'c5fb9024-5080-4527-b9ac-55f60dbccd8a'} May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:25.823384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:00:25.825801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:25.828960 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:25.829845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8d2a912d-bd54-41f4-ac19-54b24d4bdfe6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 404 len: 111 microversion: 2.1 time: 0.066438 May 13 14:00:25.830484 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 322/663] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:25 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:25.841147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-475c33ea-0357-453e-be76-62bf621acdd9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '.version_select at 0x7fb3bdce3e50>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:25.867804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-475c33ea-0357-453e-be76-62bf621acdd9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-242125846" status: 202 len: 0 microversion: 2.1 time: 0.031075 May 13 14:00:25.868558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 342/664] 10.222.0.79 () {58 vars in 1217 bytes} [Fri May 13 14:00:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-242125846 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:26.189388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:26.193827 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:26.201947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:26.203741 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:26.206669 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:26.207918 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:26.438365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:26.452564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ab1d042b-8d24-46a3-b781-accbe54d85d0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.266868 May 13 14:00:26.453477 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 323/665] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:26 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:26.629844 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f4e1df48-0419-40e3-a66c-77611042cf8f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: .version_select at 0x7fb3bde17820>, body: {"keypair": {"name": "tempest-keypair-372072097", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBR9yYth5bMbfStaCCCNbCqTIfaGQwmIjCr4xAQqcveOL3MrNGVcx9rbV5z9r+dDnNRYDSijyzEcS2mjWTpwUPL36dJKvgfmIYGcijZH7Cl2gN+IR/v4kNSncxjeC3gtUA=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:26.645624 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-f4e1df48-0419-40e3-a66c-77611042cf8f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:00:26.650473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-f4e1df48-0419-40e3-a66c-77611042cf8f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:00:26.676324 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f4e1df48-0419-40e3-a66c-77611042cf8f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050406 May 13 14:00:26.678091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 343/666] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 14:00:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:27.038246 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:27.038931 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:27.045561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.046280 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.047116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.047559 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.081493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:00:27.202424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dad47cf5-1fe2-40eb-b293-ed0472e09743 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 204 len: 0 microversion: 2.1 time: 0.167937 May 13 14:00:27.206833 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 324/667] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:00:27 2022] DELETE /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:00:27.212888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:27.213522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:27.220188 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.220859 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.221663 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.222110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.476438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:27.477399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:27.484132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.484892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.486086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.486744 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.794778 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:27.805066 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-457a5e0b-cbb1-49e0-8af9-45cd5ade826f tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1513 microversion: 2.1 time: 0.596926 May 13 14:00:27.819118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 344/668] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:27 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1513 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:27.843726 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-5cc04af2-af4f-4f92-8283-7a6ef8961d59 req-e020600d-c989-4053-a01c-bbd399e7bda1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af879bc4-815b-4dc1-ad35-0b280ad94c3a", "tag": "2a100cb6-7cc3-4a92-bd93-e27c28acc92a"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:27.860736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-5cc04af2-af4f-4f92-8283-7a6ef8961d59 req-e020600d-c989-4053-a01c-bbd399e7bda1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:27.860736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-5cc04af2-af4f-4f92-8283-7a6ef8961d59 req-e020600d-c989-4053-a01c-bbd399e7bda1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:27.878349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-5cc04af2-af4f-4f92-8283-7a6ef8961d59 req-e020600d-c989-4053-a01c-bbd399e7bda1 service nova] Creating event network-changed:2a100cb6-7cc3-4a92-bd93-e27c28acc92a for instance af879bc4-815b-4dc1-ad35-0b280ad94c3a on hv-cinder-84175 May 13 14:00:27.887306 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-5cc04af2-af4f-4f92-8283-7a6ef8961d59 req-e020600d-c989-4053-a01c-bbd399e7bda1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053919 May 13 14:00:27.888680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 345/669] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:27.936702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:27.945825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4a66d9c6-ca92-4683-a478-44afa266c94e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.476941 May 13 14:00:27.947155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 325/670] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:27 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:28.828874 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:28.829646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:28.837764 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:28.838386 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:28.839338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:28.839841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:28.966628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:28.968837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:28.994007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:28.994758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:28.995888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:28.996448 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:29.024250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:29.035993 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1a661c07-c31a-41d8-aa25-af9380307666 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1513 microversion: 2.1 time: 0.211963 May 13 14:00:29.037121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 346/671] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:28 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1513 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:29.042761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1699062800", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed6b2694-1b8c-422b-965c-287402920164"}], "security_groups": [{"name": "tempest-securitygroup--1265592605"}], "key_name": "tempest-keypair-372072097", "user_data": "}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:29.197036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] validate_networks() for [('ed6b2694-1b8c-422b-965c-287402920164', None, None, None, None, None)] {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:00:29.202454 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:29.213230 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-be1e2168-1b90-4cd8-bb25-e3c313ae51ae tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.252211 May 13 14:00:29.213934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 326/672] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:28 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:29.671243 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:00:29.673576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:00:29.673576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:00:29.674885 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:00:29.675952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:00:29.693310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:29.694070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:29.696100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:29.696694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:29.721131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:00:29.727624 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:00:29.740589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:00:29.743095 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:00:29.794554 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3de40f77-4ffb-4e0f-8d04-4edde07a95c0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.756271 May 13 14:00:29.795254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 347/673] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:00:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:00:29.810789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3c7c1cdf-6f40-4169-b3b0-86b1fcda51b2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:29.811669 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3c7c1cdf-6f40-4169-b3b0-86b1fcda51b2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:29.877743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3c7c1cdf-6f40-4169-b3b0-86b1fcda51b2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:29.895318 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3c7c1cdf-6f40-4169-b3b0-86b1fcda51b2 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1241 microversion: 2.1 time: 0.090331 May 13 14:00:29.907245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 327/674] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:29 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1241 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:30.056687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:30.057286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:30.064737 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.065362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.066126 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.066561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.232950 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:30.233778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:30.245052 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.246115 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.247266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.252297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.291365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:30.316594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6a470a8a-8747-4485-8a0d-718b3095204a tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1513 microversion: 2.1 time: 0.265707 May 13 14:00:30.317190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 348/675] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:30 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1513 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:30.493648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:30.501961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b6e2ab2c-5ece-4f1c-9ffe-9b81d684df4e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.273546 May 13 14:00:30.509119 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 328/676] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:30 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:30.706727 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-18e442d1-f48f-4c99-a75a-b1b98816412d req-a53211f7-c2ab-43a7-a948-cd25d324ab95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d5dd7d1-7ac6-4694-8e6b-ad986cb70895", "name": "network-vif-deleted", "tag": "d91af4b8-3bfe-4b09-8a48-fd5ef63b99b1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:30.718397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-18e442d1-f48f-4c99-a75a-b1b98816412d req-a53211f7-c2ab-43a7-a948-cd25d324ab95 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.719115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-18e442d1-f48f-4c99-a75a-b1b98816412d req-a53211f7-c2ab-43a7-a948-cd25d324ab95 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.736027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-18e442d1-f48f-4c99-a75a-b1b98816412d req-a53211f7-c2ab-43a7-a948-cd25d324ab95 service nova] Creating event network-vif-deleted:d91af4b8-3bfe-4b09-8a48-fd5ef63b99b1 for instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 on hv-cinder-84175 May 13 14:00:30.742266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-18e442d1-f48f-4c99-a75a-b1b98816412d req-a53211f7-c2ab-43a7-a948-cd25d324ab95 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042139 May 13 14:00:30.742913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 349/677] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:30.915715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:30.916312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:30.922789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.923238 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.924029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:30.924728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:30.997036 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:31.004919 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b4634718-c87d-4b24-92a0-00354139c34f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1293 microversion: 2.1 time: 0.093543 May 13 14:00:31.005506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 329/678] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:30 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:31.335877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:31.336505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:31.343103 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:31.343558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:31.344347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:31.344786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:31.415740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '902bea79f26a4c1d8c3c1937f99f9d4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6843d24fbf2449cbd117b8d9cfc7072', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:31.423586 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-024b9d3d-904f-4147-b53c-da77ac614fd7 tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 200 len: 1303 microversion: 2.1 time: 0.093134 May 13 14:00:31.435251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 350/679] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:31 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:31.533111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:31.534400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:31.546404 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:31.547132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:31.548579 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:31.549905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:31.707683 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:31.715884 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fca79d69-9ee3-4d2a-b48c-a7a6d6ca1541 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.190156 May 13 14:00:31.716486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 330/680] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:31 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:32.030794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:32.031785 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:32.040315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.040848 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:32.041762 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.042321 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:32.108116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:32.117245 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5b8c206b-3576-4994-9683-bc1eb8927e70 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1299 microversion: 2.1 time: 0.093028 May 13 14:00:32.117843 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 351/681] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:32 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:32.443365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:32.444328 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] [instance: 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:32.453606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.454287 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:32.455636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.456238 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:32.476523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] HTTP exception thrown: Instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 could not be found. May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Request method failure captured: May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 HTTP/1.1 May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmPPqauzCQal8DT0LoHUeFh0cpWMAnUmf1Aw6JKMKPojmrXYdcwEeU7GoZ8LpHwQgjCFwFr7MeqlpOHhQtbCpaiqITcIwhXYWZKdY1eqZ9LVPLWdL1uFXBC3bGUnf31pliIdiuZ_d7YVXw-txoPCmixdXqL2bk8Sd8w7a5dJE2UodrU May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: a6843d24fbf2449cbd117b8d9cfc7072 May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2133506172 May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:00:32.478225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_a6843d24fbf2449cbd117b8d9cfc7072"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesSnapshotTestJSON-2133506172 May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: a6843d24fbf2449cbd117b8d9cfc7072 May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2133506172 May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesSnapshotTestJSON-2133506172-project May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 902bea79f26a4c1d8c3c1937f99f9d4b May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesSnapshotTestJSON-2133506172-project May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 could not be found. May 13 14:00:32.479874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '3d5dd7d1-7ac6-4694-8e6b-ad986cb70895'} May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 could not be found. May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:00:32.480628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 could not be found. May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 could not be found. May 13 14:00:32.482029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:00:32.483354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] Returning 404 to user: Instance 3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:00:32.483354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1077ad6e-bb9e-46a4-8594-f492b4af96da tempest-VolumesSnapshotTestJSON-2133506172 tempest-VolumesSnapshotTestJSON-2133506172-project] 10.222.0.79 "GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895" status: 404 len: 111 microversion: 2.1 time: 0.041610 May 13 14:00:32.483354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 331/682] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:32 2022] GET /compute/v2.1/servers/3d5dd7d1-7ac6-4694-8e6b-ad986cb70895 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:00:32.733370 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:32.734769 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:32.744407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.745337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:32.746652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:32.748832 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:33.003793 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:33.012018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-782e7ff9-ec73-4031-bb49-0ad0d3942b5c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.282764 May 13 14:00:33.014379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 352/683] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:32 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:33.137937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:33.139554 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:33.146847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:33.147307 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:33.148103 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:33.148719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:33.350343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:33.367891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7edb022f-f597-4a4b-b108-53cfb2c58474 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.226611 May 13 14:00:33.367891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 332/684] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:33 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:33.697902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-dcf0df1f-6b00-42dc-a5e8-86a4e36b860d req-6fb583a7-80e5-44a6-a2e0-d943ce4a6f7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083c581f-911c-4e70-99f7-3ab188d35653", "tag": "62ca7b10-4ea5-44c9-9684-386fb9e14731"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:33.706933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-dcf0df1f-6b00-42dc-a5e8-86a4e36b860d req-6fb583a7-80e5-44a6-a2e0-d943ce4a6f7a service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:33.707463 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-dcf0df1f-6b00-42dc-a5e8-86a4e36b860d req-6fb583a7-80e5-44a6-a2e0-d943ce4a6f7a service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:33.725337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-dcf0df1f-6b00-42dc-a5e8-86a4e36b860d req-6fb583a7-80e5-44a6-a2e0-d943ce4a6f7a service nova] Creating event network-changed:62ca7b10-4ea5-44c9-9684-386fb9e14731 for instance 083c581f-911c-4e70-99f7-3ab188d35653 on hv-cinder-84175 May 13 14:00:33.731118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-dcf0df1f-6b00-42dc-a5e8-86a4e36b860d req-6fb583a7-80e5-44a6-a2e0-d943ce4a6f7a service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037951 May 13 14:00:33.732013 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 353/685] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:00:34.032563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:34.033227 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:34.042374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:34.042899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:34.043809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:34.044282 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:34.276202 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:34.284604 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-55706108-37a0-466c-9a33-7c124ce291e5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.256038 May 13 14:00:34.285298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 333/686] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:34 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:34.378080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:34.378804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:34.385644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:34.386128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:34.387178 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:34.387620 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:34.547700 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:34.561115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c71710a9-de66-4b9a-a4ef-b643a295d28f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.184572 May 13 14:00:34.561115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 354/687] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:34 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:35.305104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:35.305669 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:35.312185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:35.312631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:35.313403 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:35.313834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:35.462048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:35.469798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9209875d-9895-406c-8de2-2baae10baebf tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.169348 May 13 14:00:35.470490 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 334/688] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:35 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:35.575927 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:35.576486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:35.583233 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:35.583679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:35.584504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:35.584940 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:35.746142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:35.756440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dc260572-032e-414e-a54a-8dbdd79dfa52 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.184428 May 13 14:00:35.757399 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 355/689] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:35 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:36.488808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:36.490208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:36.503879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:36.504630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:36.506266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:36.507110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:36.651799 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:36.659767 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2c606420-feab-4bf3-a788-d0c61f3a08ee tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.174788 May 13 14:00:36.660364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 335/690] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:36 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:36.773566 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:36.774102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:36.780682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:36.781136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:36.781910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:36.782347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:36.917338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:36.925650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9e172d50-118f-4af2-9d76-1d58f9a55ff3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.155643 May 13 14:00:36.926308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 356/691] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:36 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:37.678100 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:37.678735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:37.685263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:37.685710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:37.686493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:37.686966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:37.825725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:37.834518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-270dfe69-5ed9-4061-ac90-0273fd529719 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.160410 May 13 14:00:37.835143 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 336/692] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:37 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:37.944485 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:37.945280 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:37.951982 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:37.952426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:37.953229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:37.953668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:38.093601 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:38.101902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-976d6900-3033-499f-a57a-9a0a11aa3c6e tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.161892 May 13 14:00:38.102486 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 357/693] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:37 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:38.852558 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:38.853275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:38.861066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:38.861521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:38.862313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:38.862790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.009231 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:39.017125 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6349d7b8-466c-4a65-b620-7aa7ec5095df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.169060 May 13 14:00:39.017722 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 337/694] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:38 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:39.119401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:39.119996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:39.126600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.127085 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.127855 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:39.128286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:39.272322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:39.279889 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9661fb49-ec74-4fde-b753-b965a85dad46 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.164405 May 13 14:00:39.280450 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 358/695] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:39 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:40.035240 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:40.036447 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:40.043268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:40.043729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:40.044621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:40.045066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:40.188586 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:40.196617 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5aff549c-89cd-4043-b5c0-34242a8b19b2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.165292 May 13 14:00:40.197205 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 338/696] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:40 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:40.296966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:40.297567 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:40.310431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:40.310926 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:40.311712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:40.312147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:40.452546 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:40.464279 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-63035b16-8553-4f0c-a1ca-b430a55ff768 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.171089 May 13 14:00:40.464873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 359/697] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:40 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:41.213604 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:41.214293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:41.221061 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:41.221510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:41.222469 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:41.222958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:41.367696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:41.375195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-02261c14-f64b-434e-8dd8-434676b7f3e7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.165470 May 13 14:00:41.375775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 339/698] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:41 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:41.485360 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:41.486171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:41.493100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:41.493548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:41.494405 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:41.494786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:41.642479 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:41.649188 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-12b3aed7-6727-44c6-9fde-0c9e37da12e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.167890 May 13 14:00:41.649779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 360/699] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:41 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:42.393883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:42.394654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:42.402674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:42.403217 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:42.404046 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:42.404493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:42.412717 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-fea72bbb-22b7-41f7-973b-0306ff4e4ca3 req-0ec09ec3-b9ea-471d-9f69-e589d76e3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083c581f-911c-4e70-99f7-3ab188d35653", "name": "network-vif-plugged", "status": "completed", "tag": "62ca7b10-4ea5-44c9-9684-386fb9e14731"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:42.421886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-fea72bbb-22b7-41f7-973b-0306ff4e4ca3 req-0ec09ec3-b9ea-471d-9f69-e589d76e3f41 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:42.422342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-fea72bbb-22b7-41f7-973b-0306ff4e4ca3 req-0ec09ec3-b9ea-471d-9f69-e589d76e3f41 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:42.438013 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-fea72bbb-22b7-41f7-973b-0306ff4e4ca3 req-0ec09ec3-b9ea-471d-9f69-e589d76e3f41 service nova] Creating event network-vif-plugged:62ca7b10-4ea5-44c9-9684-386fb9e14731 for instance 083c581f-911c-4e70-99f7-3ab188d35653 on hv-cinder-84175 May 13 14:00:42.447584 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-fea72bbb-22b7-41f7-973b-0306ff4e4ca3 req-0ec09ec3-b9ea-471d-9f69-e589d76e3f41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038943 May 13 14:00:42.448779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 361/700] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:42.589983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:42.597567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-90a21ea4-39b8-460a-a6fc-225cf570c1ad tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.208011 May 13 14:00:42.598160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 340/701] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:42 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:42.667548 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:42.668268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:42.674868 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:42.675330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:42.676113 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:42.677420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:42.810517 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:42.818091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-85a5233c-d67b-4d89-918a-b0fb618a2155 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.155715 May 13 14:00:42.818672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 362/702] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:42 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:43.614562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:43.615255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:43.622155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:43.622597 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:43.623513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:43.623947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:43.764013 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:43.772408 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0072b653-b2c3-41bc-8bb4-2e83fba28f7d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.162213 May 13 14:00:43.773002 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 341/703] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:43 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:43.835592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:43.836283 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:43.843062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:43.843515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:43.844309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:43.844842 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:43.988120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:43.995913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5d3eec23-1fc4-472f-a307-567bb034b75c tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.164709 May 13 14:00:43.996717 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 363/704] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:43 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:44.791131 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:44.791773 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:44.797772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:44.798228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:44.799302 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:44.799739 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:44.934414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:44.942167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e72e003a-d0a7-4d60-8bee-616aa606de0d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1679 microversion: 2.1 time: 0.156047 May 13 14:00:44.943465 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 342/705] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:44 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:45.013036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:45.013645 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:45.020306 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:45.021387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:45.022168 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:45.022603 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:45.156178 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:45.164123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-76048c53-60d7-4e50-9a6a-73a6c2c583f6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.154921 May 13 14:00:45.164740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 364/706] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:45 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:45.959592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:45.960541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:45.966815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:45.967277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:45.968071 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:45.968519 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:46.181991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:46.182846 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:46.189719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:46.190168 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:46.191084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:46.191525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:46.444139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:46.455785 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cc8160b1-7225-484e-9986-1bfec1a19756 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1656 microversion: 2.1 time: 0.498339 May 13 14:00:46.456401 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 343/707] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:45 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1656 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:46.471569 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:46.474539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8168080b-178b-4ab0-80b5-edb00a69fdd2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:46.481805 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8168080b-178b-4ab0-80b5-edb00a69fdd2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:46.482253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4acf8eae-2fbb-4d41-bd09-80acf618d747 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.304399 May 13 14:00:46.482686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8168080b-178b-4ab0-80b5-edb00a69fdd2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:46.483189 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 365/708] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:46 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:00:46.511688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8168080b-178b-4ab0-80b5-edb00a69fdd2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Going to try to start instance {{(pid=123511) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 14:00:46.567711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8168080b-178b-4ab0-80b5-edb00a69fdd2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action" status: 202 len: 0 microversion: 2.1 time: 0.097529 May 13 14:00:46.568803 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 344/709] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:00:46 2022] POST /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:00:46.577288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:46.578000 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:46.585209 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:46.585912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:46.586908 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:46.587527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:46.749330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:46.759903 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9d252b30-8680-49e2-ba53-f446de4b329e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1665 microversion: 2.1 time: 0.187010 May 13 14:00:46.760509 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 366/710] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:46 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1665 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:47.501172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:47.501956 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:47.508453 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.508902 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.509802 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.510418 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.650883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:47.664613 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7aa3dc12-0f47-4bbc-8bb0-2cad8bba5174 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1367 microversion: 2.1 time: 0.167737 May 13 14:00:47.666028 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 345/711] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:47 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:47.777799 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:47.778440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:47.785657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.786981 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:47.788222 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:47.788703 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.006254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:48.020794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f736430f-f399-479c-ad10-ed35719cf6d1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1665 microversion: 2.1 time: 0.246111 May 13 14:00:48.022053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 367/712] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:47 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1665 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:48.683582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.684202 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.690615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.691099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.691891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.692329 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.830430 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:48.837839 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-48f97afa-9ff8-4fb1-9eba-1fd2054dceaf tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1557 microversion: 2.1 time: 0.158193 May 13 14:00:48.838401 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 346/713] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:48 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:48.854882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:48.855451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:48.861962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.862412 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.863334 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:48.863747 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:48.947300 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c953f46f-159a-432a-a305-9f155d2016e6 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096298 May 13 14:00:48.947913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 368/714] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 14:00:48 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:00:49.039777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:00:49.040323 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:00:49.046320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:49.046874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:49.047666 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:49.048106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:49.279935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:00:49.288238 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c3befd2c-1357-4f79-bd6d-a219c41508fe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1669 microversion: 2.1 time: 0.253167 May 13 14:00:49.288821 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 347/715] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:00:49 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1669 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:00:50.027680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-2fe64c13-77d7-4d02-a84a-d3064d8173bf req-eabfd7e4-df7a-40a2-aea9-929ae227b756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "083c581f-911c-4e70-99f7-3ab188d35653", "tag": "62ca7b10-4ea5-44c9-9684-386fb9e14731"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:00:50.035772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-2fe64c13-77d7-4d02-a84a-d3064d8173bf req-eabfd7e4-df7a-40a2-aea9-929ae227b756 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:00:50.036738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-2fe64c13-77d7-4d02-a84a-d3064d8173bf req-eabfd7e4-df7a-40a2-aea9-929ae227b756 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:00:50.047929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-2fe64c13-77d7-4d02-a84a-d3064d8173bf req-eabfd7e4-df7a-40a2-aea9-929ae227b756 service nova] Creating event network-changed:62ca7b10-4ea5-44c9-9684-386fb9e14731 for instance 083c581f-911c-4e70-99f7-3ab188d35653 on hv-cinder-84175 May 13 14:00:50.053264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-2fe64c13-77d7-4d02-a84a-d3064d8173bf req-eabfd7e4-df7a-40a2-aea9-929ae227b756 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029623 May 13 14:00:50.053943 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 369/716] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:04.154056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:04.154658 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:04.161996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.162450 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.163271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.163716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.194267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-91896943-2a64-4103-814b-c77f75bc96d0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments/92511fd1-ff71-49d6-ac6a-c9758d5645d1" status: 200 len: 194 microversion: 2.20 time: 0.044311 May 13 14:01:04.194912 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 348/717] 10.222.0.79 () {60 vars in 1453 bytes} [Fri May 13 14:01:04 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments/92511fd1-ff71-49d6-ac6a-c9758d5645d1 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:01:04.261821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:04.263010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:04.271551 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.272020 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.272833 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.273261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.364558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lazy-loading 'services' on Instance uuid 19b01326-65de-403a-8020-724b6563fa64 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:01:04.446869 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7ea0a403-8935-4164-96a0-8981bb226b53 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments/92511fd1-ff71-49d6-ac6a-c9758d5645d1" status: 202 len: 0 microversion: 2.20 time: 0.190197 May 13 14:01:04.447492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 370/718] 10.222.0.79 () {60 vars in 1456 bytes} [Fri May 13 14:01:04 2022] DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments/92511fd1-ff71-49d6-ac6a-c9758d5645d1 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 14:01:04.456540 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:04.457614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:04.465499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.466495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.467928 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:04.468732 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:04.510439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4cf78564-2800-486c-88ad-301136f02e68 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.057954 May 13 14:01:04.511074 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 349/719] 10.222.0.79 () {60 vars in 1342 bytes} [Fri May 13 14:01:04 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 14:01:04.965227 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:01:04.965509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:01:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:01:05.528353 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:05.530308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:05.541991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:05.542684 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:05.544126 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:05.544937 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:05.603671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bdb7ee86-e74a-4500-8cab-d94c9054a644 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083934 May 13 14:01:05.604776 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 371/720] 10.222.0.79 () {60 vars in 1342 bytes} [Fri May 13 14:01:05 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:01:06.514334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcdf8af7-bca9-48e0-8a36-bc2107a41618"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:06.515420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:06.523297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.523752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.524550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.524988 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.616876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:06.617800 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:06.625511 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.625966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.626881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.627273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.659139 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-378ea509-1cc6-492c-b2e6-59a362b7bb31 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046613 May 13 14:01:06.660339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 372/721] 10.222.0.79 () {60 vars in 1342 bytes} [Fri May 13 14:01:06 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:06.729887 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:06.731662 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:06.740325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.740970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.741985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.742644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.775349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:01:06.821464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2fc21ce0-a158-422f-a3ed-caa23d5ee7a0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.310977 May 13 14:01:06.822425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 350/722] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:01:06 2022] POST /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments => generated 194 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:06.900574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-27eb755d-796b-4463-8332-ba2c87084618 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 204 len: 0 microversion: 2.20 time: 0.176790 May 13 14:01:06.901377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 373/723] 10.222.0.79 () {60 vars in 1279 bytes} [Fri May 13 14:01:06 2022] DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 14:01:06.915672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:06.917265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:06.924612 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.925366 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:06.927070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:06.927574 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:07.089539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:07.099326 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:07.100998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:07.102227 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cc27b3c3-2c7e-4e0f-9917-aaab30350ea3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.192418 May 13 14:01:07.102836 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 351/724] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:06 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:08.122377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:08.123130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:08.131276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:08.131784 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:08.132625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:08.133183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:08.564344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:08.573004 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:08.574883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:08.576045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dc7a606d-4e7c-4665-9ff1-7b26dae77e6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.458766 May 13 14:01:08.576603 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 374/725] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:08 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:09.597436 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:09.599291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:09.608296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:09.608918 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:09.609873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:09.610517 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:09.851158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:09.859636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:09.861172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:09.862383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6acb5a90-4317-4fba-8a54-b5906e986552 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1724 microversion: 2.20 time: 0.270292 May 13 14:01:09.863187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 352/726] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:09 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:10.338478 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-117d3259-be9e-4fec-94d0-0a8599238d58 req-bb6e3590-4a19-42bc-b3e0-f079c990059e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19b01326-65de-403a-8020-724b6563fa64", "name": "network-vif-deleted", "tag": "7212a472-72e2-4e58-9b35-4036a7195ef1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:10.352812 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-117d3259-be9e-4fec-94d0-0a8599238d58 req-bb6e3590-4a19-42bc-b3e0-f079c990059e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:10.353432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-117d3259-be9e-4fec-94d0-0a8599238d58 req-bb6e3590-4a19-42bc-b3e0-f079c990059e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:10.365742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-117d3259-be9e-4fec-94d0-0a8599238d58 req-bb6e3590-4a19-42bc-b3e0-f079c990059e service nova] Creating event network-vif-deleted:7212a472-72e2-4e58-9b35-4036a7195ef1 for instance 19b01326-65de-403a-8020-724b6563fa64 on hv-cinder-84175 May 13 14:01:10.372333 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-117d3259-be9e-4fec-94d0-0a8599238d58 req-bb6e3590-4a19-42bc-b3e0-f079c990059e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042905 May 13 14:01:10.373474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 375/727] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:10.882923 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:10.883702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:10.891906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:10.892594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:10.893356 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:10.893906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:10.935237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:10.935952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:10.937160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lazy-loading 'fault' on Instance uuid 19b01326-65de-403a-8020-724b6563fa64 {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:01:11.002126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:11.012624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:11.014427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:11.015922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-084ead85-c02b-4f07-aeb9-7d649904bd71 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 200 len: 1371 microversion: 2.20 time: 0.137535 May 13 14:01:11.023647 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 353/728] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:10 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 1371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:01:12.036627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:12.037335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:12.043901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:12.044406 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:12.045206 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:12.045645 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:12.063625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] HTTP exception thrown: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Request method failure captured: May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 HTTP/1.1 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmOA0ENgZfmI7hdGswBi5wrsxt9VVtbOaySS7Jasg0ZX37yN8k6upyCDPYTAa5ZYfNW2vbP2A21qgbRdDKXXxvW78_oI1KTgrL4MxxlQTy48hKbHWi_f9QHuUB4nR11N-Nb4DvDaO2ws_ibPVk6DCtUsYg_cP3a2H8LRyEyQTk-eHxE May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:01:12.065335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 8b2980196e0f4fafa5131dd5de02ac75 May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:01:12.067062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '19b01326-65de-403a-8020-724b6563fa64'} May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:12.068022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:01:12.069539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:12.070893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Returning 404 to user: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:12.070893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-80a0be24-2891-4a62-8633-497b1a8f4645 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 404 len: 111 microversion: 2.20 time: 0.035472 May 13 14:01:12.070893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 376/729] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:12 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:12.077501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-919fbd84-3bdf-4803-9b4a-c36c22838745 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '.version_select at 0x7fb3be370af0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:12.106820 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-919fbd84-3bdf-4803-9b4a-c36c22838745 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-192943633" status: 204 len: 0 microversion: 2.20 time: 0.033011 May 13 14:01:12.107330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 354/730] 10.222.0.79 () {60 vars in 1258 bytes} [Fri May 13 14:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-192943633 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 14:01:12.849648 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-31391c82-8edb-4d11-adc4-76335934d933 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'create', calling method: .version_select at 0x7fb3bdcb60d0>, body: {"keypair": {"name": "tempest-keypair-281751675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJdCI0uzHzHNhIWsjfjkunU7xSALv81NlcThZ29TzGclg5Sg17EPx5dZHvlWGLecCvZtZsFVPiEeUTkROTARU8v208ytZFzs+sDmV0RsiSSAP+N6kmHulmXmbPvtT6YAw=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:12.874070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-31391c82-8edb-4d11-adc4-76335934d933 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:01:12.882794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-31391c82-8edb-4d11-adc4-76335934d933 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for user 8b2980196e0f4fafa5131dd5de02ac75 and project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:01:12.923160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-31391c82-8edb-4d11-adc4-76335934d933 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.079197 May 13 14:01:12.928699 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 377/731] 10.222.0.79 () {62 vars in 1199 bytes} [Fri May 13 14:01:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 14:01:14.632814 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1354781565", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d31cc72a-07f0-4e46-83ba-2f51500ae3d4"}], "security_groups": [{"name": "tempest-securitygroup--1530039639"}], "key_name": "tempest-keypair-281751675", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:14.773029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] validate_networks() for [('d31cc72a-07f0-4e46-83ba-2f51500ae3d4', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:01:15.358285 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:01:15.358719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:01:15.359233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:01:15.359635 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:01:15.360040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:01:15.372990 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:15.373448 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:15.374270 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:15.374743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:15.396878 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:01:15.401979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Getting quotas for user 8b2980196e0f4fafa5131dd5de02ac75 and project 203eb74b5a2c444aac67940d775ecfc3. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:01:15.414376 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:01:15.416770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:01:15.490327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5fa17165-b368-423b-9120-a383f47f0c97 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.867125 May 13 14:01:15.491837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 355/732] 10.222.0.79 () {62 vars in 1187 bytes} [Fri May 13 14:01:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 14:01:15.509167 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-388cea8e-928e-46e1-943a-83f181260538 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:15.510631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-388cea8e-928e-46e1-943a-83f181260538 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:15.588258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-388cea8e-928e-46e1-943a-83f181260538 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:15.601337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-388cea8e-928e-46e1-943a-83f181260538 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:15.603794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-388cea8e-928e-46e1-943a-83f181260538 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:15.605008 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-388cea8e-928e-46e1-943a-83f181260538 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1281 microversion: 2.20 time: 0.103641 May 13 14:01:15.605641 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 378/733] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:15 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1281 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:16.592398 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:16.594086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:16.606348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:16.607206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:16.608576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:16.609293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:16.639124 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'flavor' on Instance uuid 10525e5e-f295-4923-a0b4-6674a6c3f740 {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:01:16.819028 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:16.819990 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:16.829807 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:16.830324 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:16.831370 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:16.831925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:16.841811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0d5c46fb-acf2-48c5-92f7-90624396f3e1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/action" status: 200 len: 32 microversion: 2.1 time: 0.256089 May 13 14:01:16.842952 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 356/734] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:01:16 2022] POST /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/action => generated 32 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:01:16.854773 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:16.855572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:16.863679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:16.864270 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:16.866361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:16.866843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:16.933799 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:16.945451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:16.947025 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:16.948295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6f08d654-1c5a-4fed-875d-a54afcee605f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1333 microversion: 2.20 time: 0.323315 May 13 14:01:16.949190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 379/735] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:16 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:01:17.134495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:17.151443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0274eb07-81c2-48b7-8c32-1ac1d6317a1c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.301727 May 13 14:01:17.152602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 357/736] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:16 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:17.985428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:17.986139 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:17.997806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:17.998574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:17.999920 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:18.000693 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:18.107381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:18.116148 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:18.117692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:18.118881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f3764dbc-ba45-40b4-a9ab-99e88118b5f0 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1339 microversion: 2.20 time: 0.143414 May 13 14:01:18.119680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 380/737] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:17 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:18.173264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:18.174230 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:18.187148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:18.187587 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:18.188550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:18.189053 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:18.382843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:18.407648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6d5a1f71-91c3-4927-8490-fd539ceee743 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.238842 May 13 14:01:18.409582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 358/738] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:18 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:19.113195 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-cdc0a080-81a9-4ef2-90c9-0049bf4a3a7e req-e960c204-f04c-44c7-bf45-967f155caa5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:19.127246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-cdc0a080-81a9-4ef2-90c9-0049bf4a3a7e req-e960c204-f04c-44c7-bf45-967f155caa5f service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:19.128078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-cdc0a080-81a9-4ef2-90c9-0049bf4a3a7e req-e960c204-f04c-44c7-bf45-967f155caa5f service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:19.138072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.138967 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:19.146289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:19.147192 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:19.148233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:19.148889 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:19.155087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-cdc0a080-81a9-4ef2-90c9-0049bf4a3a7e req-e960c204-f04c-44c7-bf45-967f155caa5f service nova] Creating event network-changed:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:01:19.169650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-cdc0a080-81a9-4ef2-90c9-0049bf4a3a7e req-e960c204-f04c-44c7-bf45-967f155caa5f service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127779 May 13 14:01:19.170445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 381/739] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:19.303068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:19.312097 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:19.313659 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:19.316269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-99665e01-5317-46fe-b7ab-6eb802f42624 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.182577 May 13 14:01:19.317050 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 359/740] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:19.429600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:19.430401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:19.437366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:19.438059 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:19.439680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:19.440968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:19.599547 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:19.607898 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c3956eec-d6f2-488a-ba3d-34604ac7c6b4 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.182454 May 13 14:01:19.608591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 382/741] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:19 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:20.334439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:20.335110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:20.341482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:20.341928 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:20.342688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:20.343144 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:20.476617 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:20.486741 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:20.489425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:20.490618 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c9ad66ea-94fb-4637-b023-c22853cdede3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.160050 May 13 14:01:20.491243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 360/742] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:20 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:20.723723 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:20.724372 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:20.730409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:20.730909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:20.731681 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:20.732123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:20.869330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:20.878616 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-48387eac-1dfc-4ea6-83cb-ab4990b57684 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.256482 May 13 14:01:20.881778 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 383/743] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:20 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:21.510022 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:21.510607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:21.517268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:21.517717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:21.518502 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:21.518972 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:21.652351 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:21.661482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:21.663016 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:21.664148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3e78e34b-4545-4ad2-99f8-ff5894b3147d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.158171 May 13 14:01:21.664719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 361/744] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:21 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:01:21.896371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:21.896973 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:21.903433 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:21.903876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:21.904650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:21.905078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:22.054801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:22.063293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-17cc2a2f-220f-4875-90d3-945a6d557c92 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.171274 May 13 14:01:22.063884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 384/745] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:21 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:22.682885 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:22.683624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:22.691712 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:22.692055 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:22.692839 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:22.693282 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:22.822101 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:22.829935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:22.831988 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:22.833095 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ea8e983e-7feb-491e-bc1d-758794bff4de tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.154383 May 13 14:01:22.833651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 362/746] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:22 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:23.081611 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:23.082265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:23.088668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:23.089209 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:23.089914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:23.090353 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:23.235941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:23.245193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-46324bdf-d6b5-458c-9d93-2985f3e27b2c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.167392 May 13 14:01:23.245792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 385/747] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:23 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:23.853864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:23.854610 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:23.861358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:23.861970 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:23.863225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:23.863661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:24.003725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:24.012523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:24.014049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:24.015218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6c04a8d1-7ee2-4e5d-96a3-e18420be525a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.167962 May 13 14:01:24.015783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 363/748] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:23 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:24.263487 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:24.264130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:24.271908 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:24.272365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:24.273151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:24.273592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:24.413706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:24.421939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-aa7f6916-d443-482d-811c-d4858b0ec29a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.162581 May 13 14:01:24.422818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 386/749] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:24 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:24.648673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-3c48f3ff-d3db-4f0b-be32-06de482315bd req-c29eaa28-bc7f-42eb-a483-f675aa68967c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "name": "network-vif-plugged", "status": "completed", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:24.657369 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-3c48f3ff-d3db-4f0b-be32-06de482315bd req-c29eaa28-bc7f-42eb-a483-f675aa68967c service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:24.657899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-3c48f3ff-d3db-4f0b-be32-06de482315bd req-c29eaa28-bc7f-42eb-a483-f675aa68967c service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:24.671067 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-3c48f3ff-d3db-4f0b-be32-06de482315bd req-c29eaa28-bc7f-42eb-a483-f675aa68967c service nova] Creating event network-vif-plugged:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:01:24.677590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-3c48f3ff-d3db-4f0b-be32-06de482315bd req-c29eaa28-bc7f-42eb-a483-f675aa68967c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032145 May 13 14:01:24.678361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 364/750] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:25.033094 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:25.033694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:25.039767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:25.040212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:25.040973 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:25.041405 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:25.174146 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:25.182454 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:25.183964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:25.185063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bf2b5a04-c371-4ae8-920f-79c8a05f53b4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.155876 May 13 14:01:25.185629 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 387/751] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:25 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:25.447955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:25.448741 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:25.456393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:25.456916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:25.457686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:25.458077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:25.587806 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:25.595567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f06a194f-e816-4c49-93ea-cc908bc73d40 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.151912 May 13 14:01:25.596132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 365/752] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:25 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:26.203637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:26.204263 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:26.211692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:26.212152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:26.212951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:26.213384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:26.376391 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:26.386390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:26.387974 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:26.389120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-99055038-d45c-4630-b119-07a58aa9835f tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1407 microversion: 2.20 time: 0.189418 May 13 14:01:26.389684 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 388/753] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:26 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:01:26.613982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:26.614818 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:26.621623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:26.622076 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:26.622909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:26.623343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:26.759265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:26.767734 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ddc6c3db-f74e-4ec6-a673-0b3ce0f19e45 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.157960 May 13 14:01:26.768864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 366/754] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:26 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:27.407991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:27.408551 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:27.415065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:27.415522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:27.416307 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:27.416746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:27.555047 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:27.563049 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:27.564599 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:27.566418 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c0010e77-e072-475e-b113-2ab6f77609ab tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1599 microversion: 2.20 time: 0.162462 May 13 14:01:27.567016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 389/755] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:01:27 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1599 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:01:27.583826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:27.584356 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:27.590457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:27.590939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:27.591720 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:27.592153 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:27.676004 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-51cae32c-2a8f-4a47-9d17-763ae1ceebfe tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096117 May 13 14:01:27.676653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 367/756] 10.222.0.79 () {60 vars in 1315 bytes} [Fri May 13 14:01:27 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 14:01:27.786070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:27.786824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:27.793266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:27.793708 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:27.794499 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:27.794959 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:28.020578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:28.029221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-74d4ff2e-9714-47e9-b38a-da9542260916 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.247487 May 13 14:01:28.029998 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 390/757] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:27 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:29.048865 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:29.050210 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:29.056986 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:29.057263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:29.058527 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:29.059059 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:29.143378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-09241417-38d1-4137-a101-7435aeea03ba req-f0da8fe2-1cd1-40da-80ec-c71739a2855e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:29.154332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-09241417-38d1-4137-a101-7435aeea03ba req-f0da8fe2-1cd1-40da-80ec-c71739a2855e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:29.154795 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-09241417-38d1-4137-a101-7435aeea03ba req-f0da8fe2-1cd1-40da-80ec-c71739a2855e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:29.167549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-09241417-38d1-4137-a101-7435aeea03ba req-f0da8fe2-1cd1-40da-80ec-c71739a2855e service nova] Creating event network-changed:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:01:29.174153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-09241417-38d1-4137-a101-7435aeea03ba req-f0da8fe2-1cd1-40da-80ec-c71739a2855e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036175 May 13 14:01:29.175554 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 391/758] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:29.226173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:29.236740 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c830fa3e-0e3f-49cc-bfe7-38e2197cfdf7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.193017 May 13 14:01:29.238040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 368/759] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:29 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:30.256016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:30.256744 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:30.263301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:30.263753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:30.264529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:30.264963 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:30.407040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:30.420607 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fa5f3a75-9613-45af-96d9-999a6d6f95e6 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.169324 May 13 14:01:30.421332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 392/760] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:30 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:31.438482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:31.439132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:31.448426 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:31.448887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:31.449670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:31.450108 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:31.579434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:31.587483 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f176e057-50d4-45cd-a6d7-37cf099dadda tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.152895 May 13 14:01:31.588155 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 369/761] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:31 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:31.934234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:31.935210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:31.942197 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:31.942760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:31.943454 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:31.943896 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:31.973664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ceea7b15-58fa-449f-a931-2c653cba458d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043258 May 13 14:01:31.974247 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 393/762] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:01:31 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:01:32.030422 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:32.030983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:32.037488 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:32.037947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:32.038729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:32.039204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:32.064089 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:01:32.138824 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-36c4dd68-64a5-4a33-92b8-025d32462e2e tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 204 len: 0 microversion: 2.1 time: 0.111659 May 13 14:01:32.139798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 370/763] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:01:32 2022] DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:01:32.149961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:32.150566 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:32.156820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:32.157267 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:32.158026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:32.158457 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:32.287816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:32.295276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b27d1243-7b98-492b-aec6-dcc03bc1a826 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1675 microversion: 2.1 time: 0.149439 May 13 14:01:32.295852 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 394/764] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:32 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:32.605854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:32.606560 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:32.613109 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:32.613565 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:32.614366 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:32.614840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:32.745597 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:32.753815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3a2c5686-d5da-435e-bd76-31e561187297 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.152088 May 13 14:01:32.757746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 371/765] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:32 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:33.312915 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:33.313468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:33.320598 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:33.321050 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:33.321827 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:33.322272 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:33.463039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:33.470456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fc550f30-4125-48da-9687-e3b2d4ebcc3c tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1675 microversion: 2.1 time: 0.161517 May 13 14:01:33.471064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 395/766] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:33 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:33.777318 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:33.777933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:33.784931 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:33.785391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:33.786164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:33.786605 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:33.919682 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:33.932135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-91f0bb45-e2a1-4177-918b-78862278b7c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.158599 May 13 14:01:33.932716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 372/767] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:33 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:34.488274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:34.489041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:34.496228 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:34.496853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:34.497853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:34.498293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:34.650670 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:34.658947 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7d2fa8cc-d80a-4492-9a18-5ed4c61711df tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1675 microversion: 2.1 time: 0.174787 May 13 14:01:34.659524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 396/768] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:34 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:34.949627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:34.950346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:34.957215 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:34.957669 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:34.958456 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:34.958927 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:35.099386 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:35.109772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b1839746-2db3-483b-b092-081966acadaf tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.163927 May 13 14:01:35.110942 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 373/769] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:34 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:35.676606 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:35.677912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:35.685076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:35.685523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:35.686314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:35.686783 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:35.760297 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:35.769534 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f98f9a16-d67c-4674-93b0-d5d795859b71 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1607 microversion: 2.1 time: 0.097186 May 13 14:01:35.770581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 397/770] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:35 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1607 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:35.975426 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-f1d505c3-dca0-46a4-97fc-cb850b98c998 req-29181e1f-938d-4434-a0a3-4001f5b3745d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "596ea3e4-5857-40b2-82e2-84c63e19f7da", "name": "network-vif-deleted", "tag": "0cddf8e8-d022-4c17-bc59-86e111fd692f"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:35.994615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-f1d505c3-dca0-46a4-97fc-cb850b98c998 req-29181e1f-938d-4434-a0a3-4001f5b3745d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:35.995399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-f1d505c3-dca0-46a4-97fc-cb850b98c998 req-29181e1f-938d-4434-a0a3-4001f5b3745d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.009844 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-f1d505c3-dca0-46a4-97fc-cb850b98c998 req-29181e1f-938d-4434-a0a3-4001f5b3745d service nova] Creating event network-vif-deleted:0cddf8e8-d022-4c17-bc59-86e111fd692f for instance 596ea3e4-5857-40b2-82e2-84c63e19f7da on hv-cinder-84175 May 13 14:01:36.015274 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-f1d505c3-dca0-46a4-97fc-cb850b98c998 req-29181e1f-938d-4434-a0a3-4001f5b3745d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043628 May 13 14:01:36.015854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 374/771] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:36.128968 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:36.129694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:36.137430 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.138152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.139221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.139835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.304580 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:36.314658 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a3ccfa9a-193c-4c40-b7f5-73e11755f720 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.189930 May 13 14:01:36.318229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 398/772] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:36 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:36.770977 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:36.771523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:36.778203 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.778737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.779443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.779873 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.788850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:36.789792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:36.796586 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.797423 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.798567 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.798739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.806372 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-46a297d6-0f3f-4cf4-83c7-f24234b984d4 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/ips" status: 200 len: 150 microversion: 2.1 time: 0.171951 May 13 14:01:36.806916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 375/773] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 14:01:36 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/ips => generated 150 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:36.836271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:36.836866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:36.837440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lazy-loading 'fault' on Instance uuid 596ea3e4-5857-40b2-82e2-84c63e19f7da {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:01:36.898007 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:36.910775 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1c453eb6-91cd-45d5-8e8f-59aa90eeb1fc tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 200 len: 1328 microversion: 2.1 time: 0.126178 May 13 14:01:36.922181 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 399/774] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:36 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 1328 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:37.332594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:37.333182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:37.339603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:37.340055 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:37.340847 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:37.341288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:37.478224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:37.488125 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-93d07e9c-6501-4321-8819-7369b1b770dc tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1737 microversion: 2.1 time: 0.159442 May 13 14:01:37.488792 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 376/775] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:37 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:37.930876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:37.931882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:37.938639 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:37.939114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:37.940654 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:37.941037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:37.954975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] HTTP exception thrown: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Request method failure captured: May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da HTTP/1.1 May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmN6Zp-lfe_Gy2NLJo-KLXNSIHm5GcCzTMxLWvoQdslAzU3c8rYWe6uDHaDmkg1HUYeNk4VIFqEoTIVFEl3UWkKLbHygNSwcgQ4fNlBso6-sH0-ZKwlD5GNNbRjAmyKquqnJArtK3sMOyc8Nxs1SF2_VQvhpvZW5A51v68wHQ5yWp8I May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:01:37.956671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeTestJSON-1611101519 May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a37f5d5ddd9845fbaf7d5645c31b2d40 May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:01:37.958270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '596ea3e4-5857-40b2-82e2-84c63e19f7da'} May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:37.959401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:01:37.960823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:37.962628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Returning 404 to user: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:37.962628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4c97dd3e-c1c7-4403-9e43-95a27bf63ab7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 404 len: 111 microversion: 2.1 time: 0.032180 May 13 14:01:37.962628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 400/776] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:37 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:37.967409 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0ca4a284-6c4f-42da-9688-2fe2a01bafcd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '.version_select at 0x7fb3be3c9790>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:37.988014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0ca4a284-6c4f-42da-9688-2fe2a01bafcd tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601437673" status: 202 len: 0 microversion: 2.1 time: 0.024416 May 13 14:01:37.988708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 377/777] 10.222.0.79 () {58 vars in 1220 bytes} [Fri May 13 14:01:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1601437673 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:01:38.250749 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91ef3253-a81c-42e8-b3f4-d37972af06e7"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:38.252020 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:38.258299 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:38.258800 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:38.260292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:38.260720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:38.507234 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:38.508000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:38.519930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:38.522084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:38.523145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:38.526470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:38.609269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-462b3c80-6ac4-4b87-9225-b1eddc616615 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.362532 May 13 14:01:38.610494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 401/778] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:01:38 2022] POST /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments => generated 194 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:38.783545 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4dd69146-9478-4764-a04e-d5a5288f78a0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: .version_select at 0x7fb3bdc28790>, body: {"keypair": {"name": "tempest-keypair-1672217952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAN8+UimHGR+DzWadeN+JwJUJD2UKsiusQ6az1I17/iLYm81gvWpZgQA9vcKZ1enIZ+ToQ9BLbT8u9wIs1oWeg8vBN6xLE8utFfcFSeHirCN0u6xmRxaVGOgQzIvtWuj8Q=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:38.789329 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:38.798664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4dd69146-9478-4764-a04e-d5a5288f78a0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for project ef87180052d643af940a8e2b4f21e46f. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:01:38.802841 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-85fb571a-ff3b-47f4-8d9a-71e3dd9cefca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1717 microversion: 2.1 time: 0.298676 May 13 14:01:38.805083 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4dd69146-9478-4764-a04e-d5a5288f78a0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for user a37f5d5ddd9845fbaf7d5645c31b2d40 and project ef87180052d643af940a8e2b4f21e46f. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:01:38.807404 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 378/779] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:38 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1717 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:38.835453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4dd69146-9478-4764-a04e-d5a5288f78a0 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056904 May 13 14:01:38.836228 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 402/780] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 14:01:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:38.860852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:38.862003 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:38.869396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:38.869860 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:38.870747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:38.871194 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:38.976771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] HTTP exception thrown: Cannot 'detach_volume' instance 10525e5e-f295-4923-a0b4-6674a6c3f740 while it is in vm_state rescued May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Request method failure captured: May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments/dcdf8af7-bca9-48e0-8a36-bc2107a41618 HTTP/1.1 May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOEHon-fechDwOfswGzRSlb13P_LLN7cMvEy5OQpOne3xef0PIi_Am7bNyBj-G90Vj_3-vuk46lJcBaW_wNBY3h7_ahKSU_kO0-pqOwsYA7AFwdnEZTkX6KxTynMEapY_6ISEbfWwuohB9BUCNLQk_WGYutwAYMFRpJbGaSwZXWVtM May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:01:38.978399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 20fd230cc30f4980bedebc75c620d707 May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:01:38.980168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Cannot 'detach_volume' instance 10525e5e-f295-4923-a0b4-6674a6c3f740 while it is in vm_state rescued May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'server_id': '10525e5e-f295-4923-a0b4-6674a6c3f740', 'id': 'dcdf8af7-bca9-48e0-8a36-bc2107a41618'} May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:38.981221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 10525e5e-f295-4923-a0b4-6674a6c3f740 while it is in vm_state rescued May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 10525e5e-f295-4923-a0b4-6674a6c3f740 while it is in vm_state rescued May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:38.982470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Returning 409 to user: Cannot 'detach_volume' instance 10525e5e-f295-4923-a0b4-6674a6c3f740 while it is in vm_state rescued {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:38.983906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-01820d36-99f5-409a-b380-f078bef00f0f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments/dcdf8af7-bca9-48e0-8a36-bc2107a41618" status: 409 len: 152 microversion: 2.1 time: 0.123563 May 13 14:01:38.983906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 379/781] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:01:38 2022] DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments/dcdf8af7-bca9-48e0-8a36-bc2107a41618 => generated 152 bytes in 125 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 14:01:38.990765 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:38.991939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:39.002009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:39.002788 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:39.004048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:39.005083 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:39.078678 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3e9869c1-64a0-4fc0-84a9-17ebf7e0d795 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "POST /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/action" status: 202 len: 0 microversion: 2.1 time: 0.092754 May 13 14:01:39.082956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 403/782] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:01:38 2022] POST /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:01:39.090637 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:39.091621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:39.101077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:39.101549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:39.102349 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:39.102965 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:39.248380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:39.257834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-262794e8-212a-4284-ad45-a83331ebc6ca tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1725 microversion: 2.1 time: 0.173130 May 13 14:01:39.268029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 380/783] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:39 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:40.278252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:40.279449 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:40.288594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:40.289049 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:40.289844 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:40.290275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:40.419992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1305005796", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "447dd757-4541-46df-a762-b636f2945abd"}], "security_groups": [{"name": "tempest-securitygroup--1619184859"}], "key_name": "tempest-keypair-1672217952", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:40.459467 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:40.471605 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5357e35b-9b7a-47aa-906a-ad876bda6746 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1725 microversion: 2.1 time: 0.198613 May 13 14:01:40.472188 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 404/784] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:40 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:40.531853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] validate_networks() for [('447dd757-4541-46df-a762-b636f2945abd', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:01:40.932913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:01:40.933343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:01:40.933852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:01:40.934293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:01:40.934722 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:01:40.944473 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:40.944932 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:40.945751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:40.946198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:40.964216 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for project ef87180052d643af940a8e2b4f21e46f. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:01:40.968429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Getting quotas for user a37f5d5ddd9845fbaf7d5645c31b2d40 and project ef87180052d643af940a8e2b4f21e46f. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:01:40.980128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:01:40.982420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:01:41.030788 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-db600130-e960-48b6-b678-ef2739317a14 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.614927 May 13 14:01:41.031345 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 381/785] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:01:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 14:01:41.041655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-adebb8a8-16bd-4e91-85ba-f7b11fa9d936 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:41.042400 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-adebb8a8-16bd-4e91-85ba-f7b11fa9d936 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:41.099514 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-adebb8a8-16bd-4e91-85ba-f7b11fa9d936 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:41.107669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-adebb8a8-16bd-4e91-85ba-f7b11fa9d936 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1238 microversion: 2.1 time: 0.069736 May 13 14:01:41.108634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 405/786] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:41 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:41.489995 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:41.490642 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:41.498186 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:41.498644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:41.499472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:41.499918 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:41.650751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:41.662903 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-38c76f9f-6c14-4cdd-8ae1-844f3d95c972 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1725 microversion: 2.1 time: 0.177944 May 13 14:01:41.663496 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 382/787] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:41 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:42.125641 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:42.126365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:42.133477 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:42.133938 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:42.134749 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:42.135185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:42.201756 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:42.210331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5c047a94-dfdd-4be5-b6fc-58a298c6d985 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1234 microversion: 2.1 time: 0.088641 May 13 14:01:42.210960 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 406/788] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:42 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1234 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:42.680955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:42.681562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:42.688099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:42.688549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:42.689344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:42.689779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:42.851777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:42.860565 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1f395474-55f8-4ee5-a502-7d93ed72fa85 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1731 microversion: 2.1 time: 0.183455 May 13 14:01:42.861882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 383/789] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:42 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:42.880948 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:42.883914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:42.890817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:42.891544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:42.892713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:42.893387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:42.998258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9cc796f6-6366-42ee-8062-f31721cd2331 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.123555 May 13 14:01:42.999434 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 407/790] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 14:01:42 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:43.228399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:43.229002 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:43.236168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:43.236168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:43.236629 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:43.237062 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:43.316666 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:43.324265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-85f0de07-7a68-4609-94e6-c62ee89579be tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1296 microversion: 2.1 time: 0.100019 May 13 14:01:43.324845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 384/791] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:43 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:44.354196 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:44.355054 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:44.363841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:44.364889 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:44.366777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:44.368011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:44.550014 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:44.562767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3fc0b362-33f8-4461-811b-3157f6f92783 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.217657 May 13 14:01:44.574415 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 408/792] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:44 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:44.781705 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-57f19cfa-7a45-4b54-9c9f-4bd1466a6c7e req-d29aa8af-5826-4e63-aedf-beb2a746965e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10525e5e-f295-4923-a0b4-6674a6c3f740", "tag": "882cf596-f1fe-4549-a5dc-670f7391462c"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:44.793400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-57f19cfa-7a45-4b54-9c9f-4bd1466a6c7e req-d29aa8af-5826-4e63-aedf-beb2a746965e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:44.793981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-57f19cfa-7a45-4b54-9c9f-4bd1466a6c7e req-d29aa8af-5826-4e63-aedf-beb2a746965e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:44.809021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-57f19cfa-7a45-4b54-9c9f-4bd1466a6c7e req-d29aa8af-5826-4e63-aedf-beb2a746965e service nova] Creating event network-changed:882cf596-f1fe-4549-a5dc-670f7391462c for instance 10525e5e-f295-4923-a0b4-6674a6c3f740 on hv-cinder-84175 May 13 14:01:44.815910 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-57f19cfa-7a45-4b54-9c9f-4bd1466a6c7e req-d29aa8af-5826-4e63-aedf-beb2a746965e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040900 May 13 14:01:44.816795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 385/793] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:45.582345 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:45.583380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:45.599398 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:45.600087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:45.601200 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:45.604286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:45.912831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:45.927470 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cc4ab6f0-f0a8-46e2-aa7e-bb16675c5bfe tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.349726 May 13 14:01:45.937170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 409/794] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:45 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:46.262004 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "91ef3253-a81c-42e8-b3f4-d37972af06e7"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:46.263206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:46.271348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.271947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.272839 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.273355 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.381860 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Invalid volume: volume 91ef3253-a81c-42e8-b3f4-d37972af06e7 is already attached to instances: 083c581f-911c-4e70-99f7-3ab188d35653 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: POST /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments HTTP/1.1 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 74 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:01:46.383704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {"volumeAttachment": {"volumeId": "91ef3253-a81c-42e8-b3f4-d37972af06e7"}} May 13 14:01:46.385321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Invalid volume: volume 91ef3253-a81c-42e8-b3f4-d37972af06e7 is already attached to instances: 083c581f-911c-4e70-99f7-3ab188d35653 May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'server_id': '083c581f-911c-4e70-99f7-3ab188d35653', 'body': {'volumeAttachment': {'volumeId': '91ef3253-a81c-42e8-b3f4-d37972af06e7'}}} May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 91ef3253-a81c-42e8-b3f4-d37972af06e7 is already attached to instances: 083c581f-911c-4e70-99f7-3ab188d35653 May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:46.386224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 91ef3253-a81c-42e8-b3f4-d37972af06e7 is already attached to instances: 083c581f-911c-4e70-99f7-3ab188d35653 May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:46.387673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:46.389135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:46.389135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:46.389135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:46.389135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 91ef3253-a81c-42e8-b3f4-d37972af06e7 is already attached to instances: 083c581f-911c-4e70-99f7-3ab188d35653 May 13 14:01:46.389135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:01:46.390495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 400 to user: Invalid volume: volume 91ef3253-a81c-42e8-b3f4-d37972af06e7 is already attached to instances: 083c581f-911c-4e70-99f7-3ab188d35653 {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:46.391565 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-23a16dcf-e065-4523-981a-2fa2b6b993ea tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.134286 May 13 14:01:46.392368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 386/795] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:01:46 2022] POST /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments => generated 174 bytes in 136 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 14:01:46.467110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:46.467613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:46.475111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.475832 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.476665 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.477314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.573736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'services' on Instance uuid 083c581f-911c-4e70-99f7-3ab188d35653 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:01:46.660044 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0fa06fb4-1393-4ec7-813f-a62d236df846 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments/91ef3253-a81c-42e8-b3f4-d37972af06e7" status: 202 len: 0 microversion: 2.1 time: 0.196817 May 13 14:01:46.660736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 410/796] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:01:46 2022] DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments/91ef3253-a81c-42e8-b3f4-d37972af06e7 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:01:46.669068 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:46.670027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:46.677987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.678432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.679250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.679684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.710034 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-32fd69a1-b927-48dd-8a80-b56cb3b33916 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044876 May 13 14:01:46.710596 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 387/797] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:01:46 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:46.834434 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-549bec7b-d291-4bff-8962-b63abb4cf928 req-1a8bccea-d2cb-422a-a81a-37a7eaadc6bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10525e5e-f295-4923-a0b4-6674a6c3f740", "tag": "882cf596-f1fe-4549-a5dc-670f7391462c"}, {"name": "network-changed", "server_uuid": "94c92167-c104-47be-b2d9-394e84e49fd4", "tag": "4577aed3-86f8-4344-99b2-fcdfb07f63a3"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:46.844260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-549bec7b-d291-4bff-8962-b63abb4cf928 req-1a8bccea-d2cb-422a-a81a-37a7eaadc6bf service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.844706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-549bec7b-d291-4bff-8962-b63abb4cf928 req-1a8bccea-d2cb-422a-a81a-37a7eaadc6bf service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.859072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-549bec7b-d291-4bff-8962-b63abb4cf928 req-1a8bccea-d2cb-422a-a81a-37a7eaadc6bf service nova] Creating event network-changed:882cf596-f1fe-4549-a5dc-670f7391462c for instance 10525e5e-f295-4923-a0b4-6674a6c3f740 on hv-cinder-84175 May 13 14:01:46.859419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-549bec7b-d291-4bff-8962-b63abb4cf928 req-1a8bccea-d2cb-422a-a81a-37a7eaadc6bf service nova] Creating event network-changed:4577aed3-86f8-4344-99b2-fcdfb07f63a3 for instance 94c92167-c104-47be-b2d9-394e84e49fd4 on hv-cinder-84175 May 13 14:01:46.865979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-549bec7b-d291-4bff-8962-b63abb4cf928 req-1a8bccea-d2cb-422a-a81a-37a7eaadc6bf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035965 May 13 14:01:46.867264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 411/798] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:46.945710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:46.946346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:46.952825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.953284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:46.954077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:46.954529 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.092457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:47.103396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4ee917b3-d5b3-4d65-abe6-683a8e7435e8 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.161504 May 13 14:01:47.103992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 388/799] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:46 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:47.723300 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:47.724417 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:47.731052 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:47.731507 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.732296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:47.732745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:47.765218 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-02de8d28-c5bc-48d2-ba0f-6a40f83e7b37 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047227 May 13 14:01:47.765794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 412/800] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:01:47 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:48.124926 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:48.125932 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:48.139660 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.140298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.141476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.142097 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.445523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:48.453541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a086ddd7-75e3-4ac5-929e-904987a62bf2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.335602 May 13 14:01:48.454118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 389/801] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:48 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:48.777774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:48.783727 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:48.793404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.793866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.794693 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.795182 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.839822 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fed18f1e-503f-491b-8d65-dfeaef6accb0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066772 May 13 14:01:48.840505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 413/802] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:01:48 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:01:48.901265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:48.902086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:48.909380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.909947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.911081 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:48.911627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:48.943196 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:01:49.034239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-39809b16-d180-415d-a2c2-ab5a9bf21a98 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 204 len: 0 microversion: 2.1 time: 0.136516 May 13 14:01:49.035498 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 390/803] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:01:48 2022] DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:01:49.044194 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:49.044819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:49.051765 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:49.052222 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:49.053012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:49.053456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:49.205867 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:49.213621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-315ec567-4266-4be8-ace4-4c232428f03b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1682 microversion: 2.1 time: 0.173990 May 13 14:01:49.214260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 414/804] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:49 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:49.472049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:49.472664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:49.479311 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:49.479766 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:49.480558 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:49.481104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:49.628168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:49.636117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a6bf0e71-7c79-4867-b740-1dd1c1b20dd1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.168873 May 13 14:01:49.636702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 391/805] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:49 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:50.233295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:50.234056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:50.242030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.242482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.243310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.243757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.383119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:50.391031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8f355083-d58c-4677-92c9-e06319c1c780 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1682 microversion: 2.1 time: 0.161491 May 13 14:01:50.391616 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 415/806] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:50 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:50.656278 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:50.657827 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:50.670120 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.671534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.673940 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.674963 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.876886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:50.877786 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-1c380563-b3eb-483f-8f57-64070dee3d3c req-76a6ecd5-0821-49a9-8d09-66ef661cea68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c92167-c104-47be-b2d9-394e84e49fd4", "name": "network-vif-plugged", "status": "completed", "tag": "4577aed3-86f8-4344-99b2-fcdfb07f63a3"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:50.886168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4ed75296-47c5-4e8b-af07-63b1386c479d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.236377 May 13 14:01:50.887035 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-1c380563-b3eb-483f-8f57-64070dee3d3c req-76a6ecd5-0821-49a9-8d09-66ef661cea68 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:50.887868 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-1c380563-b3eb-483f-8f57-64070dee3d3c req-76a6ecd5-0821-49a9-8d09-66ef661cea68 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:50.888380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 392/807] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:50 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:50.901028 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-1c380563-b3eb-483f-8f57-64070dee3d3c req-76a6ecd5-0821-49a9-8d09-66ef661cea68 service nova] Creating event network-vif-plugged:4577aed3-86f8-4344-99b2-fcdfb07f63a3 for instance 94c92167-c104-47be-b2d9-394e84e49fd4 on hv-cinder-84175 May 13 14:01:50.906068 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-1c380563-b3eb-483f-8f57-64070dee3d3c req-76a6ecd5-0821-49a9-8d09-66ef661cea68 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114224 May 13 14:01:50.906686 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 416/808] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:51.408516 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:51.409148 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:51.415460 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.415991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:51.416849 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.417359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:51.656653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:51.665457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3613104a-3586-4ec1-b774-9f73448b79ab tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1682 microversion: 2.1 time: 0.261230 May 13 14:01:51.666363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 393/809] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:51 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1682 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:51.905230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:51.905994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:51.923676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.924473 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:51.926121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:51.927193 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:52.125298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:52.133070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e631a560-3ba3-4fe2-b99f-3d9d558687a2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.232566 May 13 14:01:52.133663 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 417/810] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:51 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:52.395111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-91fa4f60-b05d-45ff-a195-90b55dbe1c50 req-8ffb52a3-4164-49c0-b74c-3c4ced663954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "083c581f-911c-4e70-99f7-3ab188d35653", "name": "network-vif-deleted", "tag": "62ca7b10-4ea5-44c9-9684-386fb9e14731"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:52.404000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-91fa4f60-b05d-45ff-a195-90b55dbe1c50 req-8ffb52a3-4164-49c0-b74c-3c4ced663954 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:52.404463 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-91fa4f60-b05d-45ff-a195-90b55dbe1c50 req-8ffb52a3-4164-49c0-b74c-3c4ced663954 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:52.418123 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-91fa4f60-b05d-45ff-a195-90b55dbe1c50 req-8ffb52a3-4164-49c0-b74c-3c4ced663954 service nova] Creating event network-vif-deleted:62ca7b10-4ea5-44c9-9684-386fb9e14731 for instance 083c581f-911c-4e70-99f7-3ab188d35653 on hv-cinder-84175 May 13 14:01:52.424883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-91fa4f60-b05d-45ff-a195-90b55dbe1c50 req-8ffb52a3-4164-49c0-b74c-3c4ced663954 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113691 May 13 14:01:52.426149 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 394/811] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:52.685186 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:52.685806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:52.693560 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:52.694282 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:52.695668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:52.696419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:52.745845 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:52.746377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:52.746782 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'fault' on Instance uuid 083c581f-911c-4e70-99f7-3ab188d35653 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:01:52.790171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:52.798323 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f0c529ff-3fdb-4ee3-9b66-843cb83fb2b7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 200 len: 1331 microversion: 2.1 time: 0.116930 May 13 14:01:52.799042 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 418/812] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:52 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 1331 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:53.159278 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:53.160766 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:53.167399 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.168099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.168888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.169962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.330749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:53.338869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c08f30e9-d42f-44af-a870-14ee5e25d88a tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1364 microversion: 2.1 time: 0.184570 May 13 14:01:53.339674 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 395/813] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:53 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1364 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:53.816049 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:53.816656 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:53.823240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.823688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.824527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:53.824964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:53.840713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 HTTP/1.1 May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:01:53.842455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:01:53.844080 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '083c581f-911c-4e70-99f7-3ab188d35653'} May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:01:53.845679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:01:53.847285 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:01:53.848597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:01:53.848597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bce2e3c3-a8e5-49a1-bfe3-f23ea96d4e68 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 404 len: 111 microversion: 2.1 time: 0.032029 May 13 14:01:53.848597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 419/814] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:53 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:01:53.855086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fd9f90b0-6af5-44cd-830a-ab07361f67e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '.version_select at 0x7fb3be5610d0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:53.879901 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fd9f90b0-6af5-44cd-830a-ab07361f67e9 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-372072097" status: 202 len: 0 microversion: 2.1 time: 0.028482 May 13 14:01:53.881089 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 396/815] 10.222.0.79 () {58 vars in 1217 bytes} [Fri May 13 14:01:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-372072097 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:01:54.356831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:54.357571 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:54.364615 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:54.365067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:54.365870 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:54.366317 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:54.853742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:54.862102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5b7e61ac-a692-47d4-ba1f-06abdb938984 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1550 microversion: 2.1 time: 0.509254 May 13 14:01:54.862603 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 420/816] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:54 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1550 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:01:54.880870 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:54.881482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:54.885535 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-83120f2b-fbd2-4f10-b5dc-84dccdf45c39 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: .version_select at 0x7fb3bdce31f0>, body: {"keypair": {"name": "tempest-keypair-718794561", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWxJNqBRwSt4RqtgN18nhtNWOraravqQ5DtTmlfzbvIOnP2K1KLcobRshGrbzRWfLE53om39rPpl1Y684/+5e1LCtHaIC7e4QMV9vDfZzckGv2asv0kkXQLx4JwcUlQyw=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:54.888270 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:54.888917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:54.889529 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:54.889970 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:54.899545 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-83120f2b-fbd2-4f10-b5dc-84dccdf45c39 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:01:54.903423 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-83120f2b-fbd2-4f10-b5dc-84dccdf45c39 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:01:54.931608 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-83120f2b-fbd2-4f10-b5dc-84dccdf45c39 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049730 May 13 14:01:54.932315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 421/817] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 14:01:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:01:54.978645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5156075b-d9ab-401e-b93b-1eea11395db9 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.102536 May 13 14:01:54.979269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 397/818] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 14:01:54 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:56.138691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-86eb1d5c-f4e0-4fe1-abd7-f55f6f48d991 req-29783de1-5e58-4a21-a65a-8f9f18040d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c92167-c104-47be-b2d9-394e84e49fd4", "tag": "4577aed3-86f8-4344-99b2-fcdfb07f63a3"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:56.147901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-86eb1d5c-f4e0-4fe1-abd7-f55f6f48d991 req-29783de1-5e58-4a21-a65a-8f9f18040d34 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:56.148766 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-86eb1d5c-f4e0-4fe1-abd7-f55f6f48d991 req-29783de1-5e58-4a21-a65a-8f9f18040d34 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:56.161498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-86eb1d5c-f4e0-4fe1-abd7-f55f6f48d991 req-29783de1-5e58-4a21-a65a-8f9f18040d34 service nova] Creating event network-changed:4577aed3-86f8-4344-99b2-fcdfb07f63a3 for instance 94c92167-c104-47be-b2d9-394e84e49fd4 on hv-cinder-84175 May 13 14:01:56.166967 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-86eb1d5c-f4e0-4fe1-abd7-f55f6f48d991 req-29783de1-5e58-4a21-a65a-8f9f18040d34 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033081 May 13 14:01:56.167982 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 422/819] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:01:56.331584 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-967060994", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed6b2694-1b8c-422b-965c-287402920164"}], "security_groups": [{"name": "tempest-securitygroup--1646912499"}], "key_name": "tempest-keypair-718794561", "user_data": "}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:01:56.489506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] validate_networks() for [('ed6b2694-1b8c-422b-965c-287402920164', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:01:57.114500 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:01:57.115201 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:01:57.115564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:01:57.116047 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:01:57.116584 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:01:57.131009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:57.131458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:57.132332 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:57.132717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:57.153998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:01:57.158992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Getting quotas for user 648ae92126944b50a22ad780e92df914 and project ac9b3816e0cb4400919797c107065ad4. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:01:57.173211 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:01:57.175636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:01:57.229057 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dac8d859-9183-4927-afde-adc19ae2862f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.902265 May 13 14:01:57.230044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 398/820] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:01:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:01:57.246040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5be89f5a-be14-49ba-ade0-447247962d53 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:57.247213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5be89f5a-be14-49ba-ade0-447247962d53 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:57.316046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5be89f5a-be14-49ba-ade0-447247962d53 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:57.323441 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5be89f5a-be14-49ba-ade0-447247962d53 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1240 microversion: 2.1 time: 0.086738 May 13 14:01:57.324019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 423/821] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:57 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:58.340704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:58.341296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:58.351678 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:58.352150 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:58.352932 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:58.353364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:58.460284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:58.468875 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-23f6febb-44d5-496a-ab7c-471f7e265f3f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1300 microversion: 2.1 time: 0.132194 May 13 14:01:58.470329 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 399/822] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:58 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1300 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:01:59.487884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:01:59.488574 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:01:59.496119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:59.496570 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:59.497821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:01:59.498268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:01:59.733880 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:01:59.744278 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9aab6b0f-6f4c-4069-b5f3-2f8e983861a0 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.261043 May 13 14:01:59.744883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 424/823] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:01:59 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:00.190729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-1cef0987-7f42-4215-a049-6e741cd09a44 req-0e9019c2-54ab-4ff2-aa01-a81d7e58f6d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4287d0fa-d950-4b22-abd9-d29601c0d86e", "tag": "f7ac280f-f67a-4b18-a19c-8ec5b93d3e54"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:00.202823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-1cef0987-7f42-4215-a049-6e741cd09a44 req-0e9019c2-54ab-4ff2-aa01-a81d7e58f6d6 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:00.203545 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-1cef0987-7f42-4215-a049-6e741cd09a44 req-0e9019c2-54ab-4ff2-aa01-a81d7e58f6d6 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:00.217042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-1cef0987-7f42-4215-a049-6e741cd09a44 req-0e9019c2-54ab-4ff2-aa01-a81d7e58f6d6 service nova] Creating event network-changed:f7ac280f-f67a-4b18-a19c-8ec5b93d3e54 for instance 4287d0fa-d950-4b22-abd9-d29601c0d86e on hv-cinder-84175 May 13 14:02:00.223764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-1cef0987-7f42-4215-a049-6e741cd09a44 req-0e9019c2-54ab-4ff2-aa01-a81d7e58f6d6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 May 13 14:02:00.224570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 400/824] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:00.762248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:00.762972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:00.771883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:00.772689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:00.773925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:00.774375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:00.980061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:00.988346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cff12aad-44d9-45d8-ba9a-add0a7d1d4f7 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.230020 May 13 14:02:00.988939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 425/825] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:00 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:02.011118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:02.011840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:02.018195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:02.018652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:02.019462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:02.019905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:02.200464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:02.208657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bb64cb80-396c-4159-8610-9abf21654d3a tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.205744 May 13 14:02:02.209257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 401/826] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:02 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:03.226214 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:03.227110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:03.233441 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:03.233886 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:03.234657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:03.235147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:03.376816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:03.386086 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a4a2d3c4-1e54-4710-936a-d843937d48ca tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.163320 May 13 14:02:03.387105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 426/827] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:03 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:04.402917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:04.403593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:04.414775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:04.415233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:04.416094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:04.418997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:04.559313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:04.567072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c84d2bad-5ce9-44db-9c34-efbfabedcb75 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.167989 May 13 14:02:04.567793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 402/828] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:04 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:04.872338 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-a99d2908-be38-46b7-80e4-887d160f6176 req-48def696-9819-4e69-aad2-78c5018f156b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4287d0fa-d950-4b22-abd9-d29601c0d86e", "name": "network-vif-plugged", "status": "completed", "tag": "f7ac280f-f67a-4b18-a19c-8ec5b93d3e54"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:04.882092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-a99d2908-be38-46b7-80e4-887d160f6176 req-48def696-9819-4e69-aad2-78c5018f156b service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:04.882487 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-a99d2908-be38-46b7-80e4-887d160f6176 req-48def696-9819-4e69-aad2-78c5018f156b service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:04.894878 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-a99d2908-be38-46b7-80e4-887d160f6176 req-48def696-9819-4e69-aad2-78c5018f156b service nova] Creating event network-vif-plugged:f7ac280f-f67a-4b18-a19c-8ec5b93d3e54 for instance 4287d0fa-d950-4b22-abd9-d29601c0d86e on hv-cinder-84175 May 13 14:02:04.899901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-a99d2908-be38-46b7-80e4-887d160f6176 req-48def696-9819-4e69-aad2-78c5018f156b service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031674 May 13 14:02:04.900519 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 427/829] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:05.584943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:05.585507 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:05.592011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:05.592459 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:05.593227 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:05.593663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:05.736460 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:05.745080 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-387bf1e2-f7af-4abd-8818-e03215c4fab3 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.164078 May 13 14:02:05.745665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 403/830] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:05 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:06.762721 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:06.763518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:06.770681 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:06.771169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:06.771986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:06.772505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:06.921282 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:06.929225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2d4672d7-1940-4b47-b6ba-886b9deea89b tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1366 microversion: 2.1 time: 0.171210 May 13 14:02:06.929807 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 428/831] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:06 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:07.946199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:07.946855 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:07.954236 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:07.954684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:07.955508 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:07.955944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:08.087808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:08.096135 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c5f51144-4316-4e7d-b60f-c4092ae08496 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1556 microversion: 2.1 time: 0.153821 May 13 14:02:08.096726 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 404/832] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:07 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:08.114101 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:08.114875 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:08.121485 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:08.121796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:08.122587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:08.123056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:08.218904 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ff3e3ca0-61d6-4643-8b05-5b5934317fd8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108733 May 13 14:02:08.219709 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 429/833] 10.222.0.79 () {58 vars in 1274 bytes} [Fri May 13 14:02:08 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:09.339228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-c309cb1a-8552-4f97-8ba2-02f15360a6dc req-01caa3e1-a1bd-4efd-bda7-536d45f52934 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4287d0fa-d950-4b22-abd9-d29601c0d86e", "tag": "f7ac280f-f67a-4b18-a19c-8ec5b93d3e54"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:09.348973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-c309cb1a-8552-4f97-8ba2-02f15360a6dc req-01caa3e1-a1bd-4efd-bda7-536d45f52934 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:09.349516 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-c309cb1a-8552-4f97-8ba2-02f15360a6dc req-01caa3e1-a1bd-4efd-bda7-536d45f52934 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:09.369467 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-c309cb1a-8552-4f97-8ba2-02f15360a6dc req-01caa3e1-a1bd-4efd-bda7-536d45f52934 service nova] Creating event network-changed:f7ac280f-f67a-4b18-a19c-8ec5b93d3e54 for instance 4287d0fa-d950-4b22-abd9-d29601c0d86e on hv-cinder-84175 May 13 14:02:09.375309 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-c309cb1a-8552-4f97-8ba2-02f15360a6dc req-01caa3e1-a1bd-4efd-bda7-536d45f52934 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039505 May 13 14:02:09.376506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 405/834] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:13.004579 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:13.005420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:13.011677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:13.012127 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:13.013248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:13.013367 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:13.040117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ae84b1c4-54cb-4f54-988b-5833c757fb4d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/ips" status: 200 len: 152 microversion: 2.20 time: 0.040719 May 13 14:02:13.040742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 430/835] 10.222.0.79 () {60 vars in 1288 bytes} [Fri May 13 14:02:12 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:02:15.231040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:15.231626 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:15.239142 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:15.239607 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:15.240416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:15.240849 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:15.270461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lazy-loading 'flavor' on Instance uuid 724a12c7-721b-4152-b296-d2404b24443c {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:02:15.710684 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ca2fc47b-8a10-40ff-9c70-d05f6ad97322 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/action" status: 202 len: 0 microversion: 2.20 time: 0.484305 May 13 14:02:15.711300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 406/836] 10.222.0.79 () {62 vars in 1318 bytes} [Fri May 13 14:02:15 2022] POST /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 14:02:15.720088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:15.720692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:15.727556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:15.727998 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:15.728774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:15.729204 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:15.867965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:15.876093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:15.877603 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:15.878776 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-174bf8f1-ff84-43c4-867d-b18da29ae23a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.163210 May 13 14:02:15.879339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 431/837] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:15 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:16.898697 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:16.899343 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:16.906440 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:16.907550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:16.908365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:16.908793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:17.061587 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:17.072490 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:17.075070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:17.076879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ab16f2c3-1f05-4475-8c0b-5fbfc783e417 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.182983 May 13 14:02:17.077828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 407/838] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:16 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:18.099310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:18.099923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:18.106688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:18.107389 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:18.108399 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:18.109063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:18.243782 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:18.252375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:18.253904 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:18.255105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9727d70d-f4af-4350-93e6-3e38f632c812 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.159811 May 13 14:02:18.255653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 432/839] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:18 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:19.273694 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:19.274249 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:19.285006 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:19.285455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:19.286245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:19.286729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:19.427402 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:19.434737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:19.436303 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:19.437513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-33d7124c-b89d-4959-b8e6-5479c76c0b6a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.167912 May 13 14:02:19.438072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 408/840] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:19 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:20.456530 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:20.457194 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:20.463682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:20.464120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:20.464885 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:20.465318 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:20.598320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:20.606259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:20.607799 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:20.608963 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ddcde44f-f778-4d51-ad14-b9f08ebc7834 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.156336 May 13 14:02:20.610033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 433/841] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:20 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:21.628668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:21.629295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:21.635718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:21.636170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:21.636935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:21.637369 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:21.766828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:21.774756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:21.776297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:21.777458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6b220d0a-cd64-4ec4-9f82-11749cd614aa tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.153365 May 13 14:02:21.778018 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 409/842] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:21 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:22.797347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:22.798024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:22.804308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:22.804757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:22.805539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:22.805974 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:22.935861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:22.944306 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:22.945801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:22.946979 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0b778fcf-dac6-463e-bac9-71787a74eae9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.154311 May 13 14:02:22.947536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 434/843] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:22 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:23.965139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:23.965728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:23.972239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:23.972694 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:23.973470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:23.973921 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:24.108605 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:24.116535 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:24.118027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:24.119221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0b20656b-b333-4d9a-8b69-fa152e2eceed tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.158002 May 13 14:02:24.119777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 410/844] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:23 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:25.137616 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:25.138233 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:25.144901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:25.145358 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:25.146143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:25.146584 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:25.278745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:25.287702 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:25.289211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:25.290366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b02fc3dc-4448-46be-8565-c4f60b761f43 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.156704 May 13 14:02:25.290973 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 435/845] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:25 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:26.310533 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:26.311503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:26.318085 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:26.318531 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:26.319341 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:26.319775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:26.451191 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:26.459454 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:26.460983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:26.462193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fefb59f0-5bfd-4e2f-bef1-3849c9fc28db tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.157025 May 13 14:02:26.462780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 411/846] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:26 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:27.413026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:27.413557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:27.420179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.420631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.421390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.422369 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.481087 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:27.481721 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:27.491266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.492077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.493032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.493480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.512518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'services' on Instance uuid 10525e5e-f295-4923-a0b4-6674a6c3f740 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:02:27.584264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0e140716-55e3-4c25-9a79-d1dc8e823138 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments/dcdf8af7-bca9-48e0-8a36-bc2107a41618" status: 202 len: 0 microversion: 2.1 time: 0.174987 May 13 14:02:27.585021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 436/847] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:02:27 2022] DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments/dcdf8af7-bca9-48e0-8a36-bc2107a41618 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:02:27.593521 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:27.594577 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:27.604412 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.605000 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.606604 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:27.606604 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:27.640527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-520e4236-fe74-42cc-989c-bd1428227e65 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050931 May 13 14:02:27.641104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 437/848] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:02:27 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:27.644581 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:27.649820 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:27.651390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:27.652553 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3ce05479-df03-4c22-a3a4-3c335ef2a772 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.175411 May 13 14:02:27.653243 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 412/849] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:27 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:28.652336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:28.653278 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:28.659643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:28.660086 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:28.660858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:28.661314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:28.671375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:28.671987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:28.678743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:28.679190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:28.680117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:28.681652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:28.694157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cb3c85a9-212a-438b-b616-68bd5902bcb1 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045761 May 13 14:02:28.695084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 438/850] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:02:28 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:28.831008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:28.839267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:28.840777 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:28.841964 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2fc318ae-d9a5-4c8b-8357-e5bd277457a3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.174904 May 13 14:02:28.842518 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 413/851] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:28 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:29.706901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:29.707825 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:29.714379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.714863 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.715637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.716071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.745738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4aa37a5f-22b6-479c-ad19-269e231b4398 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043694 May 13 14:02:29.746451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 439/852] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:02:29 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:02:29.826346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:29.826955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:29.833913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.834365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.835214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.835723 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.861377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:29.862194 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:29.868897 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.869125 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:02:29.869354 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.870143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.870572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.961539 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4da36e50-6946-443f-b89b-f4917b50173a tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 204 len: 0 microversion: 2.1 time: 0.139368 May 13 14:02:29.962187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 414/853] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:02:29 2022] DELETE /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:02:29.975400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:29.976881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:29.987280 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.988076 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:29.989269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:29.989758 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:30.071682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:30.082580 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:30.084145 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:30.085316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bc76e8f6-8efd-47b0-91bd-7c68497de735 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.228590 May 13 14:02:30.085866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 440/854] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:29 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:30.139975 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:30.149545 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9c93c614-182c-414a-9a9c-a68af367320e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1691 microversion: 2.1 time: 0.182381 May 13 14:02:30.150141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 415/855] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:29 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:31.103731 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:31.104382 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:31.111026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:31.111482 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:31.112268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:31.112703 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:31.166845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:31.167470 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:31.174371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:31.174871 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:31.175671 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:31.176118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:31.280112 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:31.288736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:31.290244 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:31.291463 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fe458dd4-3d0e-4be2-977f-c1e96b862c39 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.191690 May 13 14:02:31.292031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 441/856] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:31 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:31.339010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:31.347302 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-10e70ae4-8223-428f-a0a6-db0a96458c29 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1691 microversion: 2.1 time: 0.184434 May 13 14:02:31.347876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 416/857] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:31 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1691 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:32.310155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:32.310807 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:32.317263 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:32.317721 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:32.318496 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:32.318961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:32.364914 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:32.365530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:32.371971 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:32.372433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:32.373245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:32.373692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:32.486858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:32.494956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:32.496445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:32.497595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1e41b979-4d41-4e84-941c-1da70a7a5f67 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.191520 May 13 14:02:32.498157 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 442/858] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:32 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:32.530393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:32.538397 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-12e7a736-ec2a-41a3-9820-314da0cb7e5c tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1691 microversion: 2.1 time: 0.177371 May 13 14:02:32.538990 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 417/859] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:32 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1691 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:33.517484 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:33.518087 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:33.524642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:33.525096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:33.525899 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:33.526340 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:33.555334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:33.555950 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:33.563164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:33.563621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:33.564411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:33.564846 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:33.720879 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:33.729175 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:33.730862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:33.732143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3bfbf1af-31e7-491e-bc0a-ad8394692461 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.219612 May 13 14:02:33.732788 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 443/860] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:33 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:33.744654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:33.754136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-90cc7064-d2a6-40de-8746-81887de43847 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1691 microversion: 2.1 time: 0.202596 May 13 14:02:33.754730 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 418/861] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:33 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1691 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:34.752271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:34.752271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:34.758727 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:34.759197 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:34.760105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:34.760549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:34.772385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:34.773249 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:34.779924 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:34.780474 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:34.782136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:34.782582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:35.046011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:35.049816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:35.055913 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5b87c3d5-d20c-4c61-8ef1-5f6c1e93474e tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1691 microversion: 2.1 time: 0.287561 May 13 14:02:35.057057 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 419/862] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:34 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1691 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:35.057912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:35.059680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:35.061349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-427f8193-6e05-44f5-9798-9c9817753dd7 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.314081 May 13 14:02:35.062498 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 444/863] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:34 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:35.651484 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-78bca11d-59ff-47ed-b019-d534a4cd989c req-effb9462-d83a-45d0-879f-e627294a0501 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10525e5e-f295-4923-a0b4-6674a6c3f740", "name": "network-vif-deleted", "tag": "882cf596-f1fe-4549-a5dc-670f7391462c"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:35.660340 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-78bca11d-59ff-47ed-b019-d534a4cd989c req-effb9462-d83a-45d0-879f-e627294a0501 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:35.660790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-78bca11d-59ff-47ed-b019-d534a4cd989c req-effb9462-d83a-45d0-879f-e627294a0501 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:35.672601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-78bca11d-59ff-47ed-b019-d534a4cd989c req-effb9462-d83a-45d0-879f-e627294a0501 service nova] Creating event network-vif-deleted:882cf596-f1fe-4549-a5dc-670f7391462c for instance 10525e5e-f295-4923-a0b4-6674a6c3f740 on hv-cinder-84175 May 13 14:02:35.677654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-78bca11d-59ff-47ed-b019-d534a4cd989c req-effb9462-d83a-45d0-879f-e627294a0501 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029799 May 13 14:02:35.678449 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 420/864] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:36.074834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:36.075738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:36.085715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:36.086436 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.086592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.086979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:36.088139 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.088636 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.099818 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.100281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.101823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.102608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.149061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:36.149559 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:36.150279 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'fault' on Instance uuid 10525e5e-f295-4923-a0b4-6674a6c3f740 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:02:36.220956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:36.250643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2ff1bf13-9a07-4a88-b29b-14bbfd0674c8 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 200 len: 1335 microversion: 2.1 time: 0.179460 May 13 14:02:36.253093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 445/865] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:36 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:36.311330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:36.320463 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:36.321999 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:36.323295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-38377834-6abf-4bd8-9f48-14a88a4189ae tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.246234 May 13 14:02:36.323869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 421/866] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:36 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:37.273418 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:37.274036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 10525e5e-f295-4923-a0b4-6674a6c3f740] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:37.281288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.281740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.282583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.282994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.296784 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] HTTP exception thrown: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 could not be found. May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Request method failure captured: May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 HTTP/1.1 May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmOEHon-fechDwOfswGzRSlb13P_LLN7cMvEy5OQpOne3xef0PIi_Am7bNyBj-G90Vj_3-vuk46lJcBaW_wNBY3h7_ahKSU_kO0-pqOwsYA7AFwdnEZTkX6KxTynMEapY_6ISEbfWwuohB9BUCNLQk_WGYutwAYMFRpJbGaSwZXWVtM May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:02:37.298424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 20fd230cc30f4980bedebc75c620d707 May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 could not be found. May 13 14:02:37.300076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '10525e5e-f295-4923-a0b4-6674a6c3f740'} May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 could not be found. May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:02:37.301106 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 could not be found. May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 could not be found. May 13 14:02:37.302625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:02:37.304211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Returning 404 to user: Instance 10525e5e-f295-4923-a0b4-6674a6c3f740 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:02:37.304211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f2ae5c3e-65f1-4c8b-92d1-800e39dfd43f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740" status: 404 len: 111 microversion: 2.1 time: 0.030374 May 13 14:02:37.304211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 446/867] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:37 2022] GET /compute/v2.1/servers/10525e5e-f295-4923-a0b4-6674a6c3f740 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:02:37.309062 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5f1d7a80-08dc-4a41-9066-8ce8afed6a6b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '.version_select at 0x7fb3be4109d0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:37.326596 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5f1d7a80-08dc-4a41-9066-8ce8afed6a6b tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465732726" status: 202 len: 0 microversion: 2.1 time: 0.021376 May 13 14:02:37.327211 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 422/868] 10.222.0.79 () {58 vars in 1220 bytes} [Fri May 13 14:02:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1465732726 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:02:37.341911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:37.342565 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:37.350039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.350488 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.351363 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.351720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.538339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:37.547541 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:37.549070 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:37.550266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2404a83c-7d9f-4205-8f1d-61f86263ee1d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1745 microversion: 2.20 time: 0.212434 May 13 14:02:37.552062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 447/869] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:37 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1745 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:37.666762 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:37.667262 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:37.674366 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.674859 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.675651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.676092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.701230 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:02:37.780247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f473275c-e1c3-4cef-84ff-2029ab76607b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 204 len: 0 microversion: 2.1 time: 0.117155 May 13 14:02:37.780905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 423/870] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:02:37 2022] DELETE /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:02:37.789186 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:37.789738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:37.796826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.797286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.798072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:37.798517 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:37.936792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:37.945308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1b9cec7a-fd99-4914-92f1-abf0221853bd tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1578 microversion: 2.1 time: 0.160151 May 13 14:02:37.945893 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 448/871] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:37 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:38.570300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:38.571058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:38.577618 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:38.578067 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:38.578882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:38.579317 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:38.717049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:38.726455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:38.727971 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:38.729131 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0c569fb8-6632-4952-8493-0de9224b7952 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1745 microversion: 2.20 time: 0.163332 May 13 14:02:38.729742 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 424/872] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:38 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:38.964212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:38.965475 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:38.972914 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:38.973377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:38.974170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:38.974613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:39.075030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-6babe3f7-7cfd-4cac-86d0-fc0f27ff93a6 req-5b391b2b-ae39-4cb2-9538-f723e49887a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "name": "network-vif-plugged", "status": "completed", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:39.085361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-6babe3f7-7cfd-4cac-86d0-fc0f27ff93a6 req-5b391b2b-ae39-4cb2-9538-f723e49887a9 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:39.085944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-6babe3f7-7cfd-4cac-86d0-fc0f27ff93a6 req-5b391b2b-ae39-4cb2-9538-f723e49887a9 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:39.101475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-6babe3f7-7cfd-4cac-86d0-fc0f27ff93a6 req-5b391b2b-ae39-4cb2-9538-f723e49887a9 service nova] Creating event network-vif-plugged:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:02:39.107048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-6babe3f7-7cfd-4cac-86d0-fc0f27ff93a6 req-5b391b2b-ae39-4cb2-9538-f723e49887a9 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035431 May 13 14:02:39.107675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 425/873] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:39.112961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:39.120835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-64e7bf42-8016-4683-b37f-9bb41d22d9d0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1578 microversion: 2.1 time: 0.161162 May 13 14:02:39.121430 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 449/874] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:38 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:39.749048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:39.749748 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:39.756174 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:39.756632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:39.757421 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:39.757892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:39.889431 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:39.898037 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:39.899602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:39.900828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4c606a4c-e2ba-4bd0-b859-90fa583f2865 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1745 microversion: 2.20 time: 0.156518 May 13 14:02:39.901391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 426/875] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:39 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:40.137528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:40.138148 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:40.144994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.145429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.146210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.146642 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.306008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:40.306501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:40.317151 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.317656 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.318525 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.319002 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.356115 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:02:40.376530 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:40.386804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-44f42c61-0e37-49f7-bb40-b6902b0e1d7f tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1578 microversion: 2.1 time: 0.253053 May 13 14:02:40.388136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 450/876] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:40 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1578 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:40.393531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:40.394272 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:40.402309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.403229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.404231 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.404676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.436219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d3ed553a-e751-4992-99d0-9df6c5413636 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/ips" status: 200 len: 145 microversion: 2.1 time: 0.046947 May 13 14:02:40.437416 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 451/877] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 14:02:40 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:40.472388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-afd8854b-a6c1-4031-97cc-6726f4921e99 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "DELETE /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 204 len: 0 microversion: 2.1 time: 0.169685 May 13 14:02:40.476358 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 427/878] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:02:40 2022] DELETE /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 14:02:40.481436 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:40.482075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:40.492092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.492843 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.493831 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.494256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.741164 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:40.751879 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-81c8183a-4c7e-4b51-b935-a4937e29dd27 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1509 microversion: 2.1 time: 0.273928 May 13 14:02:40.752629 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 452/879] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:40 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1509 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:40.919001 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:40.919991 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:40.934954 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.941209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:40.943247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:40.943982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.235781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:41.247675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:41.249739 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:41.250973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7b17a8b6-36fa-4f41-9826-bded9f494580 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.336482 May 13 14:02:41.270573 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 428/880] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:40 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:41.352413 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-bf6b96b8-5deb-4d2e-803a-5f9b7ab6e36c req-0eb70e7b-70c3-428a-aecc-5675e4e1d8df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af879bc4-815b-4dc1-ad35-0b280ad94c3a", "name": "network-vif-deleted", "tag": "2a100cb6-7cc3-4a92-bd93-e27c28acc92a"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:41.362949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-bf6b96b8-5deb-4d2e-803a-5f9b7ab6e36c req-0eb70e7b-70c3-428a-aecc-5675e4e1d8df service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.363646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-bf6b96b8-5deb-4d2e-803a-5f9b7ab6e36c req-0eb70e7b-70c3-428a-aecc-5675e4e1d8df service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.382141 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-bf6b96b8-5deb-4d2e-803a-5f9b7ab6e36c req-0eb70e7b-70c3-428a-aecc-5675e4e1d8df service nova] Creating event network-vif-deleted:2a100cb6-7cc3-4a92-bd93-e27c28acc92a for instance af879bc4-815b-4dc1-ad35-0b280ad94c3a on hv-cinder-84175 May 13 14:02:41.392378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-bf6b96b8-5deb-4d2e-803a-5f9b7ab6e36c req-0eb70e7b-70c3-428a-aecc-5675e4e1d8df service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044223 May 13 14:02:41.393784 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 453/881] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:41.405704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:41.406993 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:41.421869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.422652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.424779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.425434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.529833 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:41.546485 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a678a5c6-06bb-40c5-a9ce-f797805ff6f2 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1510 microversion: 2.1 time: 0.146324 May 13 14:02:41.547771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 429/882] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:41 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1510 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:41.775119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:41.777327 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:41.785824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.786294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.787872 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.791098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.904035 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:41.905110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:41.941408 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.941978 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:41.942623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:41.943160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.024534 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:42.033308 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0c0e2f5c-06e2-4e71-a33f-081a1511e9c0 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1509 microversion: 2.1 time: 0.266597 May 13 14:02:42.039116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 454/883] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:41 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:42.278248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:42.278900 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:42.289533 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.290067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.290796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.291242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.553402 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0fe994bf-211c-4ee1-876c-5b21214e61a7 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.646464 May 13 14:02:42.557942 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 430/884] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:02:41 2022] POST /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments => generated 194 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:42.606825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:42.617578 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:42.708775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.714967 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.716673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.719078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.758348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:42.777225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:42.803301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:42.804930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-58c22c8a-1074-4475-a4f0-7945d7d431f3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.530496 May 13 14:02:42.808321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:42.809203 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 455/885] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:42 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:42.810377 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:42.812979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lazy-loading 'fault' on Instance uuid af879bc4-815b-4dc1-ad35-0b280ad94c3a {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:02:42.919707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:42.942817 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b6a5b8f2-9af3-4434-8a12-dd397db547f0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 200 len: 1230 microversion: 2.1 time: 0.357343 May 13 14:02:42.943480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 431/886] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:42 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 1230 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:43.056268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:43.057270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:43.066385 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.078798 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.081283 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.081911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.233911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:43.247143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fb5d7788-8578-4a89-b75e-5f15534cff5f tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1467 microversion: 2.1 time: 0.193219 May 13 14:02:43.257544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 456/887] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:43 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1467 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:43.413374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-9311909b-ae48-4725-991d-12382e1d9c52 req-b162cfca-4f4b-4103-9e7f-836ac85ed9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0371ede2-e0ba-463b-b866-27b37ecdd87c", "name": "network-vif-deleted", "tag": "b7847ace-539c-49f8-8691-796f0be69992"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:43.431257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9311909b-ae48-4725-991d-12382e1d9c52 req-b162cfca-4f4b-4103-9e7f-836ac85ed9d0 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.431979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9311909b-ae48-4725-991d-12382e1d9c52 req-b162cfca-4f4b-4103-9e7f-836ac85ed9d0 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.475300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-9311909b-ae48-4725-991d-12382e1d9c52 req-b162cfca-4f4b-4103-9e7f-836ac85ed9d0 service nova] Creating event network-vif-deleted:b7847ace-539c-49f8-8691-796f0be69992 for instance 0371ede2-e0ba-463b-b866-27b37ecdd87c on hv-cinder-84175 May 13 14:02:43.490373 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-9311909b-ae48-4725-991d-12382e1d9c52 req-b162cfca-4f4b-4103-9e7f-836ac85ed9d0 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081905 May 13 14:02:43.491667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 432/888] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:43.841519 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:43.843017 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:43.850933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.851950 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.852916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.853512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.961576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:43.962296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:43.970877 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.971235 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.972621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:43.973284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:43.991981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] HTTP exception thrown: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Request method failure captured: May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a HTTP/1.1 May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmQ54ptFvSdWAAnE_OGlh3GK0K68_2nsI80RShqAxWJsef2riFTjB7STBKP2vmec9bePAskGvlNupLKYgSsFLmF7RaHulJpPfyswEOV9j24XGe6aMCrecu6MYbDJAoshSGKCvxSuqEvkskqiSaJi_f8mkj0tctUIqlUkcKRe_NhLO-4 May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:02:43.993961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-TestVolumeBootPattern-462252894 May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-TestVolumeBootPattern-462252894-project May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: a27e83f9f5fb4a0b99e7fac6ab90b3e4 May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-TestVolumeBootPattern-462252894-project May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:02:43.995701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'af879bc4-815b-4dc1-ad35-0b280ad94c3a'} May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:02:43.996661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:02:43.998173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:44.000825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Returning 404 to user: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:02:44.001908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f12f5bfc-5a73-44d6-800f-938d09b32fce tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 404 len: 111 microversion: 2.1 time: 0.045056 May 13 14:02:44.002491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 433/889] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:43 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:02:44.144377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:44.157755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:44.159637 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:44.161019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-40af2095-cef1-4360-bc2a-f9dc3dcdcbac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.323804 May 13 14:02:44.173039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 457/890] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:43 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:44.230551 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-209530342", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-323121193", "security_groups": [{"name": "tempest-secgroup-smoke-1743970202"}], "block_device_mapping_v2": [{"uuid": "6af80944-6ebe-4508-94fa-1f697e2dddad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03a70c19-db79-42a5-9674-8042863a7bc5"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:44.268270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:44.275657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:44.291128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:44.292351 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:44.294017 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:44.295458 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:44.382522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:44.383511 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:44.384625 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'fault' on Instance uuid 0371ede2-e0ba-463b-b866-27b37ecdd87c {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:02:44.478531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:44.488710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] validate_networks() for [('03a70c19-db79-42a5-9674-8042863a7bc5', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:02:44.500938 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f7dfc020-9473-41e8-866c-2e0da0f23edd tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 200 len: 1312 microversion: 2.1 time: 0.239808 May 13 14:02:44.514945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 458/891] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:44 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:44.996269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:02:44.997301 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:02:44.997852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:02:44.998501 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:02:44.999664 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:02:45.014100 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.015466 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.016297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.016742 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.036181 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:02:45.040548 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for user a27e83f9f5fb4a0b99e7fac6ab90b3e4 and project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:02:45.104383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:02:45.106828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6af80944-6ebe-4508-94fa-1f697e2dddad',volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:02:45.181722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:45.182328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:45.189380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.190071 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.191213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.191646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.296708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d5d11a45-e8b7-45d2-9d2a-c5302a5192b0 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.078151 May 13 14:02:45.304776 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 434/892] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:02:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1089 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:02:45.317255 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ca78f730-4983-433b-8734-407e6711e0c3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:45.319429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ca78f730-4983-433b-8734-407e6711e0c3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:45.418590 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ca78f730-4983-433b-8734-407e6711e0c3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:45.433764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ca78f730-4983-433b-8734-407e6711e0c3 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1093 microversion: 2.1 time: 0.127584 May 13 14:02:45.435201 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 435/893] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:45 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1093 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:45.457355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:45.471783 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:45.474575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:45.475894 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-22ce6b2b-16e8-460e-ae84-d6651713ddbf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.298705 May 13 14:02:45.490872 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 459/894] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:45 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:45.523538 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:45.524500 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 0371ede2-e0ba-463b-b866-27b37ecdd87c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:45.531389 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.532145 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.533318 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.533969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.553204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] HTTP exception thrown: Instance 0371ede2-e0ba-463b-b866-27b37ecdd87c could not be found. May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Request method failure captured: May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c HTTP/1.1 May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOEHon-fechDwOfswGzRSlb13P_LLN7cMvEy5OQpOne3xef0PIi_Am7bNyBj-G90Vj_3-vuk46lJcBaW_wNBY3h7_ahKSU_kO0-pqOwsYA7AFwdnEZTkX6KxTynMEapY_6ISEbfWwuohB9BUCNLQk_WGYutwAYMFRpJbGaSwZXWVtM May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:02:45.555113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 20fd230cc30f4980bedebc75c620d707 May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 0371ede2-e0ba-463b-b866-27b37ecdd87c could not be found. May 13 14:02:45.556493 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '0371ede2-e0ba-463b-b866-27b37ecdd87c'} May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0371ede2-e0ba-463b-b866-27b37ecdd87c could not be found. May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:02:45.557344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0371ede2-e0ba-463b-b866-27b37ecdd87c could not be found. May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0371ede2-e0ba-463b-b866-27b37ecdd87c could not be found. May 13 14:02:45.558588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:45.560591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Returning 404 to user: Instance 0371ede2-e0ba-463b-b866-27b37ecdd87c could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:02:45.562289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-47c6d677-28a5-42a9-9036-847a90ddb410 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c" status: 404 len: 111 microversion: 2.1 time: 0.044946 May 13 14:02:45.564671 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 436/895] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:45 2022] GET /compute/v2.1/servers/0371ede2-e0ba-463b-b866-27b37ecdd87c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:02:45.571991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:45.572768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:45.579521 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.580234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.581392 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.582072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.627426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:02:45.747472 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-12490cf4-11f6-461b-bc09-160714d945e7 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 204 len: 0 microversion: 2.1 time: 0.179140 May 13 14:02:45.751269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 460/896] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:02:45 2022] DELETE /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:02:45.758198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:45.759746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:45.769226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.769686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.770489 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:45.771007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:45.953503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:45.965394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-97138bde-db41-4329-97c6-301704bdf359 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.212640 May 13 14:02:45.970659 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 437/897] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:45 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:46.455381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:46.456563 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:46.464862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.465336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:46.466343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.467002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:46.518796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:46.522513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:46.547126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.549177 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:46.550251 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.550969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:46.565156 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:46.574655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ef65f69f-a105-4f6e-9eca-2d2a8dd204e7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1143 microversion: 2.1 time: 0.124866 May 13 14:02:46.587269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 461/898] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:46 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1143 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:46.723408 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:46.731828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:46.734090 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:46.741945 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9268451e-bf46-4eaf-a7f0-97b314666331 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.244219 May 13 14:02:46.747106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 438/899] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:46 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:46.989374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:46.993730 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:46.999384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:46.999937 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.000805 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:47.001322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.171476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:47.180520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d928d2aa-7c1e-48be-9b1a-00d80160917d tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.195953 May 13 14:02:47.183159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 462/900] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:46 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:47.594110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:47.595297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:47.601845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:47.602570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.603432 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:47.603936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.679166 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:47.690378 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a53cd536-8591-4a9f-b8b0-2aadc3dc6058 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1143 microversion: 2.1 time: 0.100756 May 13 14:02:47.691006 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 439/901] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:47 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1143 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:47.760198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:47.760896 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:47.772084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:47.772535 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.773319 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:47.773752 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:47.934153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:47.944567 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:47.946518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:47.946518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3c735b20-c2bb-4ac2-9bd6-584e9a63dd4c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.189633 May 13 14:02:47.946773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 463/902] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:47 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:48.205902 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:48.206872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:48.215591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.216380 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.218080 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.218692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.431127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:48.440808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a09a10c5-3754-4816-89a4-e767fcf81873 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.242994 May 13 14:02:48.441378 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 440/903] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:48 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:48.708031 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:48.709029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:48.720732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.721651 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.723023 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.723635 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.798503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:48.810403 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0c5b2176-d80f-4dee-a010-a3999a8b1996 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1191 microversion: 2.1 time: 0.106593 May 13 14:02:48.820297 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 464/904] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:48 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1191 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:48.966798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:48.968442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:48.988942 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.990592 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:48.991731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:48.992954 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.461279 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:49.462380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:49.482495 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:49.491046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.492259 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:49.493440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.496617 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:49.511705 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:49.519195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:49.520654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-479c2b84-96d5-43ba-9867-b6c58265ef33 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.559461 May 13 14:02:49.534755 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 441/905] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:48 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:49.828895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:49.829663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:49.837904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:49.838941 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.839179 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:49.839614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:49.987881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:50.001418 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ed5dfa58-00b8-4ad2-b052-2795409c8585 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1521 microversion: 2.1 time: 0.543971 May 13 14:02:50.011708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:50.015934 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 465/906] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:49 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:50.021059 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c8c0eaec-6517-47be-9d5d-f60c75fe687a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1209 microversion: 2.1 time: 0.196114 May 13 14:02:50.022547 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 442/907] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:49 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1209 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:50.272438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-96c28f58-8aaf-493d-8983-a772d438d7a8 req-eb9430dd-c528-477a-a85f-a131f172af89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c44ce14-5d23-453e-bfde-1fb8c8d74c2a", "name": "network-vif-deleted", "tag": "ce3869b7-d2b1-485b-b44b-6654613759f1"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:50.291722 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-96c28f58-8aaf-493d-8983-a772d438d7a8 req-eb9430dd-c528-477a-a85f-a131f172af89 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:50.294067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-96c28f58-8aaf-493d-8983-a772d438d7a8 req-eb9430dd-c528-477a-a85f-a131f172af89 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:50.325188 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-96c28f58-8aaf-493d-8983-a772d438d7a8 req-eb9430dd-c528-477a-a85f-a131f172af89 service nova] Creating event network-vif-deleted:ce3869b7-d2b1-485b-b44b-6654613759f1 for instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a on hv-cinder-84175 May 13 14:02:50.339494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-96c28f58-8aaf-493d-8983-a772d438d7a8 req-eb9430dd-c528-477a-a85f-a131f172af89 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075663 May 13 14:02:50.341060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 466/908] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:50.548837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:50.549760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:50.574845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:50.575248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:50.576078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:50.576522 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:50.892971 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:50.917700 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:50.923032 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:50.925754 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6db150e9-f24f-4147-a664-d59fb0b1780a tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.381286 May 13 14:02:50.927383 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 443/909] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:50 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:51.025933 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:51.028152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:51.039768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.041322 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.041479 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:51.041999 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:51.043166 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.043801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.057864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.058264 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.059171 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.059622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.100055 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.100959 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.104207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lazy-loading 'fault' on Instance uuid 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:02:51.259663 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20fd230cc30f4980bedebc75c620d707', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef89791b177f4bf0ba916f133c79f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:51.272980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-35cbe9c6-a39e-4627-b613-d2dd1fa758a5 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 200 len: 1311 microversion: 2.1 time: 0.253172 May 13 14:02:51.274342 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 467/910] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:51 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 1311 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:51.307940 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:51.323718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-80576ce5-0fa1-45c4-93f1-f41a5d0339db tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1277 microversion: 2.1 time: 0.285710 May 13 14:02:51.324774 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 444/911] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:51 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1277 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:51.478381 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:51.491516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:51.508594 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.508946 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.509604 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.510027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.548761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cf1d1ae8-b69b-4f39-9b51-76f79b881996 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074671 May 13 14:02:51.555483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 468/912] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:02:51 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:51.560237 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:51.561185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:51.571195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.571195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.572568 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.573263 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.625710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9a7587a6-082a-4e2f-8de6-8c3e1e3557c1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f" status: 200 len: 194 microversion: 2.1 time: 0.069427 May 13 14:02:51.627367 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 445/913] 10.222.0.79 () {58 vars in 1412 bytes} [Fri May 13 14:02:51 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f => generated 194 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:51.953354 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:51.955758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:51.974840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.975952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.978689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:51.979879 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:51.998537 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-5baa119a-9d9b-4cef-8e62-aae1d2a17d41 req-75e10435-e145-45d2-9a0b-832757762814 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8fc32b-674b-4112-bea2-ca2a5c3ce812", "tag": "f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:52.024902 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-5baa119a-9d9b-4cef-8e62-aae1d2a17d41 req-75e10435-e145-45d2-9a0b-832757762814 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.025419 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-5baa119a-9d9b-4cef-8e62-aae1d2a17d41 req-75e10435-e145-45d2-9a0b-832757762814 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.061396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-5baa119a-9d9b-4cef-8e62-aae1d2a17d41 req-75e10435-e145-45d2-9a0b-832757762814 service nova] Creating event network-changed:f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7 for instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 on hv-cinder-84175 May 13 14:02:52.071905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-5baa119a-9d9b-4cef-8e62-aae1d2a17d41 req-75e10435-e145-45d2-9a0b-832757762814 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077604 May 13 14:02:52.078843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 446/914] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:52.291423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:52.292138 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] [instance: 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:52.325908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.326364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.327776 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.328218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.366254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] HTTP exception thrown: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a could not be found. May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Request method failure captured: May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a HTTP/1.1 May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOEHon-fechDwOfswGzRSlb13P_LLN7cMvEy5OQpOne3xef0PIi_Am7bNyBj-G90Vj_3-vuk46lJcBaW_wNBY3h7_ahKSU_kO0-pqOwsYA7AFwdnEZTkX6KxTynMEapY_6ISEbfWwuohB9BUCNLQk_WGYutwAYMFRpJbGaSwZXWVtM May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:02:52.368552 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef89791b177f4bf0ba916f133c79f33a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ef89791b177f4bf0ba916f133c79f33a May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1965674745 May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 20fd230cc30f4980bedebc75c620d707 May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1965674745-project May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a could not be found. May 13 14:02:52.372113 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '3c44ce14-5d23-453e-bfde-1fb8c8d74c2a'} May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a could not be found. May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:02:52.374396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a could not be found. May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a could not be found. May 13 14:02:52.377295 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:02:52.380881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] Returning 404 to user: Instance 3c44ce14-5d23-453e-bfde-1fb8c8d74c2a could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:02:52.380881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5d1396bd-ef15-4b55-a660-f3275910bdd3 tempest-ServerRescueNegativeTestJSON-1965674745 tempest-ServerRescueNegativeTestJSON-1965674745-project] 10.222.0.79 "GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a" status: 404 len: 111 microversion: 2.1 time: 0.083220 May 13 14:02:52.380881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 447/915] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:52 2022] GET /compute/v2.1/servers/3c44ce14-5d23-453e-bfde-1fb8c8d74c2a => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:02:52.382960 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:52.383462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:52.397738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.398297 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.399202 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:52.399912 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:52.420811 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:52.430515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:52.432431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:52.433773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7f481b42-65bc-41d9-bf0c-fb689b7ee156 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.487270 May 13 14:02:52.434371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 469/916] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:51 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:52.987336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:52.995717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a6328892-5a7e-4919-8775-2ee6c05c4d0a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.616856 May 13 14:02:52.995717 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 448/917] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:52 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:53.193771 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b6855b4-c8ca-442c-9fa2-cabc34f6eabe"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:53.195065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:53.201809 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.202365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:53.203277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.203790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:53.469272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:53.470596 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:53.477547 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.478520 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:53.479704 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:53.480335 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:53.775534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:53.788825 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:53.791726 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:53.797411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b9e1d232-106b-4c11-bc33-a03dac63d8e4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1740 microversion: 2.20 time: 0.331321 May 13 14:02:53.799530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 449/918] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:53 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:53.874684 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ebd75e3b-b96e-4c08-84e3-6490fcb45b77 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "POST /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684369 May 13 14:02:53.876329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 470/919] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:02:53 2022] POST /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments => generated 194 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:54.013369 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:54.014022 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:54.020293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:54.021021 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:54.021760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:54.023946 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:54.433543 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:54.442325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a6375e31-0d4b-48f8-b9a4-71f9cebc43ed tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.432646 May 13 14:02:54.442951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 450/920] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:54 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:54.825557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:54.826676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:54.836335 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:54.837169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:54.838361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:54.838953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:55.083354 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:55.092483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:55.094022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:55.095223 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ef7942f9-416f-4e25-bd49-ea59363aac3c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1722 microversion: 2.20 time: 0.274834 May 13 14:02:55.095779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 471/921] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:54 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:55.469030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:55.469642 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:55.492799 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:55.494392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:55.495719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:55.496222 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:55.902850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:55.921863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-69b5c5a3-089e-496c-8da8-df603d3f7bbe tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.457344 May 13 14:02:55.934911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 451/922] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:55 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:56.127823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:56.129688 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:56.142549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:56.143505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:56.144484 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:56.145309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:56.406374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:56.421894 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:56.425888 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:56.428105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7b8fe60f-ca4b-4af9-b9bd-f2e4560423e9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1722 microversion: 2.20 time: 0.307657 May 13 14:02:56.428694 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 472/923] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:56 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:02:56.946215 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:56.947497 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:56.959772 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:56.960555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:56.962511 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:56.963346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.070664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:57.071199 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:57.080107 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.080825 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.081816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.082427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.123557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c27351fc-1c66-4b0f-9a25-aead0b0015a8 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/ips" status: 200 len: 149 microversion: 2.1 time: 0.054967 May 13 14:02:57.124811 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 473/924] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 14:02:57 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:57.163774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-4c29f318-fa94-4bca-aa75-680c2d4eae27 req-3551530c-eaca-40f0-a7b8-f82078ae1742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "name": "network-vif-unplugged", "status": "completed", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:57.185102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-4c29f318-fa94-4bca-aa75-680c2d4eae27 req-3551530c-eaca-40f0-a7b8-f82078ae1742 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.185770 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-4c29f318-fa94-4bca-aa75-680c2d4eae27 req-3551530c-eaca-40f0-a7b8-f82078ae1742 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.203638 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-4c29f318-fa94-4bca-aa75-680c2d4eae27 req-3551530c-eaca-40f0-a7b8-f82078ae1742 service nova] Creating event network-vif-unplugged:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:02:57.214143 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-4c29f318-fa94-4bca-aa75-680c2d4eae27 req-3551530c-eaca-40f0-a7b8-f82078ae1742 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063158 May 13 14:02:57.215288 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 474/925] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:02:57.264475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:57.283752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5e78d95a-76ad-43be-8aa1-525c7f49d5b9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.344203 May 13 14:02:57.285014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 452/926] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:56 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:02:57.451178 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:57.452277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:57.461501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.461866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.463346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.464492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.710466 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:57.720374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:57.722666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:57.724823 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-108b0a00-3b51-4e38-b684-cf548343da62 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1665 microversion: 2.20 time: 0.278505 May 13 14:02:57.726086 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 475/927] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:57 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1665 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:57.751481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3019afeb-d6a5-4733-aae0-535cdd6d804d"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:57.753212 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:57.760159 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.760936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:57.761958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:57.762606 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.200368 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8df25ab7-d467-44db-ae65-bb609ddad312 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.454884 May 13 14:02:58.201745 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 453/928] 10.222.0.79 () {62 vars in 1363 bytes} [Fri May 13 14:02:57 2022] POST /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-volume_attachments => generated 188 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 14:02:58.301680 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:58.302513 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:58.310671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.311283 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.312835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.313583 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.361657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:58.362164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:58.368503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.368986 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.369826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.370197 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.475712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:58.485024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d70f91ac-bfdf-487a-b128-f81240112523 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.187281 May 13 14:02:58.485581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 476/929] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:58 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:02:58.711072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dcfc54ea-a0e7-4a7e-8073-c6d52bb2fc52 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-volume_attachments/3019afeb-d6a5-4733-aae0-535cdd6d804d" status: 202 len: 0 microversion: 2.20 time: 0.353999 May 13 14:02:58.712066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 454/930] 10.222.0.79 () {60 vars in 1456 bytes} [Fri May 13 14:02:58 2022] DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-volume_attachments/3019afeb-d6a5-4733-aae0-535cdd6d804d => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 14:02:58.735225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebffd910-12e2-44cd-86e0-a3198eacc1ec"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:58.736401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:58.742930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.743630 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.744440 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.744887 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.792351 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:02:58.793969 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:58.801091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.801542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.802325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.802970 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.912520 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b89b2c2c-e7d2-4497-94d0-c16a76b298ac tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "POST /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/action" status: 202 len: 0 microversion: 2.20 time: 0.125379 May 13 14:02:58.914894 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 455/931] 10.222.0.79 () {62 vars in 1318 bytes} [Fri May 13 14:02:58 2022] POST /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 14:02:58.927601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:58.929725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:58.939711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.940199 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:58.942022 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:58.942856 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:59.126506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:59.135141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:59.136651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:59.138076 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b734409c-a64d-4cd8-bd18-5cc32e0b09d9 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1673 microversion: 2.20 time: 0.217703 May 13 14:02:59.138805 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 456/932] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:02:58 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:02:59.504067 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:02:59.505542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:02:59.513112 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:59.514414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:59.516526 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:02:59.517391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:02:59.615223 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7008be9f-5141-4d26-ba58-22f06bb8c6fa tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "POST /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.884250 May 13 14:02:59.617059 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 477/933] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:02:58 2022] POST /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments => generated 194 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:02:59.746583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:02:59.755344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6d4a1b6d-434f-4cd4-b781-59cff94a53c7 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.255184 May 13 14:02:59.756315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 457/934] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:02:59 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:03:00.162774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:00.163986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:00.178196 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.179216 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.180791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.181737 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.377780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.386119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.387670 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:00.388994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4441830e-35ec-448e-a504-9a56066292f6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1673 microversion: 2.20 time: 0.235210 May 13 14:03:00.390316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 478/935] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:00 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:00.779624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:00.781496 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:00.796882 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.797830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:00.799390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:00.800352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:01.066308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:01.078602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3f720495-1dcf-457e-8da4-2b0e421a1b14 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.308805 May 13 14:03:01.080316 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 458/936] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:00 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:01.410849 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:01.411559 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:01.418898 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:01.419358 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:01.420431 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:01.421492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:01.628141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:01.630216 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:01.640583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:01.641310 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:01.642625 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:01.643170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:01.735842 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d2270bba-f2d9-4baa-9218-2dd51f842834 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.114939 May 13 14:03:01.744300 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 459/937] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:03:01 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments => generated 371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:01.744787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:01.784916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:01.788213 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:01.791523 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-41cbe22d-dc8c-4143-b961-315f59575dd2 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.383888 May 13 14:03:01.805079 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 479/938] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:01 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:01.893413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:01.894585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:01.905167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:01.907654 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:01.913659 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:01.914679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.001193 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-04834c37-7a79-47a0-8c47-16c2742122f4 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f" status: 200 len: 194 microversion: 2.1 time: 0.113081 May 13 14:03:02.002784 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 460/939] 10.222.0.79 () {58 vars in 1412 bytes} [Fri May 13 14:03:01 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f => generated 194 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:02.019971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:02.021078 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:02.034109 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.035114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.037038 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.038225 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.106666 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:02.107334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:02.117992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.118827 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.120320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.121119 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.237868 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lazy-loading 'services' on Instance uuid 94c92167-c104-47be-b2d9-394e84e49fd4 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:02.343163 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-abe4e7f1-1ade-493e-9491-4267c7662ea3 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f" status: 202 len: 0 microversion: 2.1 time: 0.332306 May 13 14:03:02.344039 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 480/940] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:03:02 2022] DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/1f268f0e-ca78-4ad1-b8f4-74bdbb5ba50f => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:02.452126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:02.464410 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e8bda2fe-1ec5-40ee-adf8-4845752a3508 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.363161 May 13 14:03:02.488677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 461/941] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:02 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:03:02.827668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:02.828847 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:02.840925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.841745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:02.843281 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:02.844635 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:03.101889 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:03.118271 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:03.120647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:03.123713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5629c71c-a792-44f2-b6f5-3350a077aec4 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.302062 May 13 14:03:03.126598 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 481/942] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:02 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:03.385897 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-4278e4d4-efc4-449f-b80e-98c59cf36798 req-3253ab65-835d-4f03-b06e-0eb9ad0e7052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8fc32b-674b-4112-bea2-ca2a5c3ce812", "name": "network-vif-plugged", "status": "completed", "tag": "f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:03.396984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-4278e4d4-efc4-449f-b80e-98c59cf36798 req-3253ab65-835d-4f03-b06e-0eb9ad0e7052 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:03.397742 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-4278e4d4-efc4-449f-b80e-98c59cf36798 req-3253ab65-835d-4f03-b06e-0eb9ad0e7052 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:03.417896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-4278e4d4-efc4-449f-b80e-98c59cf36798 req-3253ab65-835d-4f03-b06e-0eb9ad0e7052 service nova] Creating event network-vif-plugged:f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7 for instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 on hv-cinder-84175 May 13 14:03:03.426424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-4278e4d4-efc4-449f-b80e-98c59cf36798 req-3253ab65-835d-4f03-b06e-0eb9ad0e7052 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044537 May 13 14:03:03.427691 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 462/943] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:03.495592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:03.501874 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:03.526248 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:03.549402 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:03.551424 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:03.552772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:03.993162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:04.018952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e1f111a2-ad69-4ba0-b9f8-6b62e203f09b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.540360 May 13 14:03:04.026894 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 482/944] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:03 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:04.153352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:04.161715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:04.193557 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:04.196244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:04.201280 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:04.207507 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:04.812267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:04.833504 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:04.847374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:04.849454 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e62880f9-4e93-4048-9ef6-0c884aff0912 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.706496 May 13 14:03:04.887274 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 463/945] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:04 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:05.048260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:05.049421 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:05.067640 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:05.068676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:05.070562 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:05.071497 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:05.376464 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:05.387328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ae8b54af-c3cc-4f86-b022-5aa169a25a4e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.350685 May 13 14:03:05.388112 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 483/946] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:05 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:05.879771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:05.880248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:05.896495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:05.897775 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:05.899058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:05.899981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:06.170137 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:06.184852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:06.187745 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:06.190509 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-613e0777-eb6a-4562-b69a-aa8a9eded92d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.316116 May 13 14:03:06.192672 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 464/947] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:05 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:06.419575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:06.421854 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:06.429205 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:06.430148 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:06.431240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:06.432159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:06.707592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:06.723150 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b2b6af54-ab63-4c5f-b252-c89a7116d333 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.314033 May 13 14:03:06.724769 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 484/948] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:06 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:07.220065 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:07.221188 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:07.233185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:07.235189 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:07.236987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:07.238004 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:07.451393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:07.460146 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:07.461905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:07.463170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f8acbb59-23ed-4951-a584-b6dca0ef0997 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.248786 May 13 14:03:07.463745 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 465/949] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:07 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:07.751291 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:07.752425 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:07.762023 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:07.762608 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:07.763538 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:07.764061 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:08.107859 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:08.143512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7abaa23c-16d9-4a3a-bd25-a107d6e19e92 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.398513 May 13 14:03:08.144135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 485/950] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:07 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:08.493073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:08.493891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:08.515625 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:08.516078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:08.516880 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:08.518266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:08.787024 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:08.798090 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:08.799881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:08.801126 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6705256e-2aaf-4613-9c37-a28025e20dca tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.315222 May 13 14:03:08.801701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 466/951] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:08 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:09.164820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:09.166387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:09.175581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:09.176453 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:09.177653 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:09.178314 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:09.426130 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:09.434404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a5e26a38-1ca5-4dbf-9eab-e4e21ccdf49a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.275709 May 13 14:03:09.435048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 486/952] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:09 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:03:09.826860 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:09.829462 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:09.847168 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:09.847755 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:09.849120 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:09.850121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:10.058968 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:10.068996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:10.070525 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:10.071881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9abcc9eb-0f57-4a96-a601-9d244029614b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.253797 May 13 14:03:10.072467 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 467/953] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:09 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:10.457462 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:10.458940 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:10.468591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:10.469274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:10.470312 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:10.470943 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:10.666834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:10.681917 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-161712e6-1527-4089-a515-53805ad6fbd1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.232214 May 13 14:03:10.683512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 487/954] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:10 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:11.091720 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:11.092597 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:11.100074 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:11.100521 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:11.101336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:11.101768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:11.273077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:11.283389 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:11.284921 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:11.286187 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-30133def-efa5-416b-8acd-869581e283c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.198441 May 13 14:03:11.286760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 468/955] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:11 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:11.700074 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:11.700997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:11.707728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:11.708237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:11.709245 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:11.709897 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:11.881837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:11.891257 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8e445884-9577-40bf-8734-ba6c1fd259e1 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.195864 May 13 14:03:11.892504 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 488/956] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:11 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:12.304963 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:12.305679 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:12.312180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:12.312636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:12.313437 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:12.313911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:12.445298 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:12.454044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:12.455613 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:12.456781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5a1be78e-b09d-48f4-8e28-07ba5b0cc002 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.155867 May 13 14:03:12.457341 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 469/957] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:12 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:12.908462 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:12.909210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:12.915835 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:12.916332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:12.917053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:12.917493 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:13.051400 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:13.058658 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c8cfbf47-1d26-4053-adf8-2eccfca2eca6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1265 microversion: 2.1 time: 0.154065 May 13 14:03:13.059536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 489/958] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:12 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:13.474993 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:13.475618 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:13.482082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:13.482528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:13.483334 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:13.484371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:13.618632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:13.629821 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:13.631444 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:13.632648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-bd77ad5a-4acf-4b6f-bcf0-a749fe1ee0eb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.161635 May 13 14:03:13.633222 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 470/959] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:13 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:14.077999 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:14.079133 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:14.085313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:14.085767 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:14.086553 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:14.087037 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:14.235471 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:14.243273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2d6e60c7-5552-4bb9-b85c-92a1ca54e35c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1451 microversion: 2.1 time: 0.170535 May 13 14:03:14.244198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 490/960] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:14 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1451 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:14.260044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:14.260468 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:14.267793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:14.268272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:14.269163 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:14.269751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:14.423040 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:14.432707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-14d005f2-5f90-4ec4-a692-de291f89d505 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1451 microversion: 2.1 time: 0.176436 May 13 14:03:14.433331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 471/961] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:14 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1451 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:03:14.650269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:14.651539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:14.658447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:14.659110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:14.660685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:14.660685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:14.822814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:14.831734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:14.833246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:14.834732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-300a453d-94d7-4f93-b092-51472046af28 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.188212 May 13 14:03:14.835307 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 491/962] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:14 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:15.854319 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:15.854947 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:15.864909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:15.866402 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:15.867609 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:15.868392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.044316 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:16.054856 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:16.056647 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:16.057888 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0c1bddb5-5d49-43b8-b074-08206f6f2356 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.208360 May 13 14:03:16.058512 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 472/963] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:15 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:16.317929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:16.318573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:16.331890 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.332701 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.334403 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.335527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.462544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'services' on Instance uuid 4287d0fa-d950-4b22-abd9-d29601c0d86e {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:16.568647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d8853572-8737-402b-9c98-9154b35d1e64 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments/ebffd910-12e2-44cd-86e0-a3198eacc1ec" status: 202 len: 0 microversion: 2.1 time: 0.254757 May 13 14:03:16.569452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 492/964] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:03:16 2022] DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments/ebffd910-12e2-44cd-86e0-a3198eacc1ec => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:16.578879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:16.580066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:16.586744 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.587553 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.588618 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.588758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-71f54e10-95e2-410b-a96b-31e3adbfa027 req-ba27eff8-79d0-4be8-a455-8597c58bfb3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8fc32b-674b-4112-bea2-ca2a5c3ce812", "tag": "f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:16.589136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.598240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-71f54e10-95e2-410b-a96b-31e3adbfa027 req-ba27eff8-79d0-4be8-a455-8597c58bfb3d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:16.598671 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-71f54e10-95e2-410b-a96b-31e3adbfa027 req-ba27eff8-79d0-4be8-a455-8597c58bfb3d service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:16.611687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-71f54e10-95e2-410b-a96b-31e3adbfa027 req-ba27eff8-79d0-4be8-a455-8597c58bfb3d service nova] Creating event network-changed:f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7 for instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 on hv-cinder-84175 May 13 14:03:16.617705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-71f54e10-95e2-410b-a96b-31e3adbfa027 req-ba27eff8-79d0-4be8-a455-8597c58bfb3d service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033491 May 13 14:03:16.618292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 493/965] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:16.626016 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-489b6c1d-aa81-499d-9d87-88b1217d811f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051931 May 13 14:03:16.626774 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 473/966] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:03:16 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:17.087524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:17.088748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:17.101503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.102182 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.109905 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.109905 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.390998 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-89669b97-a095-4512-9cc2-479fb044500b req-3fe421d8-d3f3-4dde-b47a-a6180da5a6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "name": "network-vif-plugged", "status": "completed", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:17.413280 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-89669b97-a095-4512-9cc2-479fb044500b req-3fe421d8-d3f3-4dde-b47a-a6180da5a6da service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.414246 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-89669b97-a095-4512-9cc2-479fb044500b req-3fe421d8-d3f3-4dde-b47a-a6180da5a6da service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.445179 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-89669b97-a095-4512-9cc2-479fb044500b req-3fe421d8-d3f3-4dde-b47a-a6180da5a6da service nova] Creating event network-vif-plugged:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:03:17.463796 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-89669b97-a095-4512-9cc2-479fb044500b req-3fe421d8-d3f3-4dde-b47a-a6180da5a6da service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076853 May 13 14:03:17.472718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 474/967] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:17.644899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:17.646127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:17.660071 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.660538 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.662261 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.662261 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.681833 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:17.709310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:17.713659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:17.716159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5f730079-e718-4fd1-b835-8d8960d786e1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.634621 May 13 14:03:17.717332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 494/968] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:17 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:03:17.732424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-46aa7390-da19-43a6-9fa1-966799e45cc5 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096797 May 13 14:03:17.735219 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 475/969] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:03:17 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:17.948428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:17.948948 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:17.961845 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.964474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:17.966679 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:17.967709 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.009792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-841a2cea-29c2-487c-8837-8c0f76fdec2d tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/5b6855b4-c8ca-442c-9fa2-cabc34f6eabe" status: 200 len: 194 microversion: 2.1 time: 0.065399 May 13 14:03:18.010408 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 495/970] 10.222.0.79 () {58 vars in 1412 bytes} [Fri May 13 14:03:17 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/5b6855b4-c8ca-442c-9fa2-cabc34f6eabe => generated 194 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:18.022144 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:18.022962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:18.033455 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.034221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.035714 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.036515 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.167346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lazy-loading 'services' on Instance uuid 94c92167-c104-47be-b2d9-394e84e49fd4 {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:18.319650 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2edf7a8c-67fd-4b59-b516-e3ffc48060d2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/5b6855b4-c8ca-442c-9fa2-cabc34f6eabe" status: 202 len: 0 microversion: 2.1 time: 0.300222 May 13 14:03:18.320801 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 476/971] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:03:18 2022] DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments/5b6855b4-c8ca-442c-9fa2-cabc34f6eabe => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:18.738683 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:18.740977 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:18.747325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:18.748227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.748566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:18.748882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.750239 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.750686 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.756488 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.756945 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.757736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.758174 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.799756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8fe78c53-c024-44e0-b898-7bc056ba46ec tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.055001 May 13 14:03:18.799756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 477/972] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:03:18 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 14:03:18.878630 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:18.879961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:18.892364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.893178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.894633 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:18.895765 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:18.923066 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:18.933136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:18.934913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:18.936277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f2d35658-bbb6-4892-a5d0-afffe2590837 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.202574 May 13 14:03:18.937703 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 496/973] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:18 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:18.941248 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:19.040696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9f0968fe-2cad-4dcd-888b-466663fbd5ad tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 204 len: 0 microversion: 2.1 time: 0.169208 May 13 14:03:19.041400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 478/974] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:18 2022] DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 14:03:19.054824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:19.056002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:19.067388 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:19.068211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:19.069344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:19.070129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:19.282877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:19.291484 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e59453fa-e1ce-4505-b943-1f110acd77ac tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1680 microversion: 2.1 time: 0.243652 May 13 14:03:19.292076 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 497/975] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:19 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1680 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:19.957817 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:19.960361 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:19.967574 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:19.968033 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:19.968876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:19.970186 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:20.124651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:20.133321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:20.134974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:20.136144 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0baf2029-e0ff-4183-a315-512dfc536421 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1731 microversion: 2.20 time: 0.184551 May 13 14:03:20.136725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 479/976] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:19 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:20.309137 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:20.310509 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:20.322820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:20.323643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:20.325062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:20.325876 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:20.548268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:20.556922 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-03a68f82-4998-44ff-b648-0198a7e71982 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1680 microversion: 2.1 time: 0.251756 May 13 14:03:20.557488 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 498/977] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:20 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1680 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:21.154803 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:21.156114 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:21.164057 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:21.164485 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:21.165430 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:21.166095 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:21.318877 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:21.328869 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:21.330542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:21.331868 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1eb52f16-03e6-4a59-b301-eb2c15b794c5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1718 microversion: 2.20 time: 0.181725 May 13 14:03:21.332573 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 480/978] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:03:21 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1718 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:03:21.578855 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:21.581291 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:21.595491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:21.596262 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:21.597073 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:21.598570 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:21.868441 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:21.883379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7e570ea6-60a4-4cb4-a916-33eb9a407e41 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1680 microversion: 2.1 time: 0.312351 May 13 14:03:21.894287 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 499/979] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:21 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:22.616528 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-7a5d6732-2853-4eeb-8dda-86f1fbd5ab7e req-2277224d-ac2f-41e6-aa2e-dc2b274703a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4287d0fa-d950-4b22-abd9-d29601c0d86e", "name": "network-vif-deleted", "tag": "f7ac280f-f67a-4b18-a19c-8ec5b93d3e54"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:22.626549 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-7a5d6732-2853-4eeb-8dda-86f1fbd5ab7e req-2277224d-ac2f-41e6-aa2e-dc2b274703a8 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.627051 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-7a5d6732-2853-4eeb-8dda-86f1fbd5ab7e req-2277224d-ac2f-41e6-aa2e-dc2b274703a8 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.643496 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-7a5d6732-2853-4eeb-8dda-86f1fbd5ab7e req-2277224d-ac2f-41e6-aa2e-dc2b274703a8 service nova] Creating event network-vif-deleted:f7ac280f-f67a-4b18-a19c-8ec5b93d3e54 for instance 4287d0fa-d950-4b22-abd9-d29601c0d86e on hv-cinder-84175 May 13 14:03:22.648970 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-7a5d6732-2853-4eeb-8dda-86f1fbd5ab7e req-2277224d-ac2f-41e6-aa2e-dc2b274703a8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036783 May 13 14:03:22.651950 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 481/980] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:22.833441 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:22.834428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:22.840550 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.841002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.841776 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.842216 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.872228 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9f749ef0-fbcd-4815-9ab0-1ffd786b07a5 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043138 May 13 14:03:22.872797 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 500/981] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:03:22 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:03:22.902060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:22.902789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:22.910117 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.910573 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.911393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.911831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.948268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:22.948719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:22.949170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lazy-loading 'fault' on Instance uuid 4287d0fa-d950-4b22-abd9-d29601c0d86e {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:22.989873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:22.993090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:22.999706 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:23.000455 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.001198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:23.001913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.002588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '648ae92126944b50a22ad780e92df914', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac9b3816e0cb4400919797c107065ad4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:23.011102 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3195814b-a6c4-4429-938c-30f95a8655fd tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 200 len: 1330 microversion: 2.1 time: 0.113391 May 13 14:03:23.011849 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 482/982] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:22 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:23.031817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3d8530c7-2c4a-4f19-9cf5-7af13f464861 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045841 May 13 14:03:23.032447 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 501/983] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:03:22 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 14:03:23.099842 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:23.100327 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:23.107431 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:23.107886 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.109182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:23.109617 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.137907 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:03:23.229942 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-70a2cc32-3de5-4b30-bd85-6a3cf37a9877 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 204 len: 0 microversion: 2.1 time: 0.133530 May 13 14:03:23.230562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 483/984] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:23 2022] DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 14:03:23.240377 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:23.241009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:23.248169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:23.248973 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.250768 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:23.251209 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:23.409931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:23.418026 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0f37dbe5-5ea4-445c-a80d-7ce53ee01136 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1674 microversion: 2.1 time: 0.182425 May 13 14:03:23.419260 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 502/985] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:23 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1674 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:24.028864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:24.029572 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:24.036132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:24.036576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:24.037349 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:24.037819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:24.051580 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e HTTP/1.1 May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:24.053223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:24.054951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '4287d0fa-d950-4b22-abd9-d29601c0d86e'} May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:24.055789 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:24.057665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:24.059108 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:24.059108 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0e7512ef-cb07-481a-8d28-c41b9651701d tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 404 len: 111 microversion: 2.1 time: 0.030056 May 13 14:03:24.059108 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 484/986] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:24 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:24.064065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c07022e5-3b55-44ca-bb4d-33d598a11e49 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '.version_select at 0x7fb3bdc48f70>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:24.082124 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c07022e5-3b55-44ca-bb4d-33d598a11e49 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-718794561" status: 202 len: 0 microversion: 2.1 time: 0.022254 May 13 14:03:24.082769 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 503/987] 10.222.0.79 () {58 vars in 1217 bytes} [Fri May 13 14:03:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-718794561 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:24.444084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:24.444778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:24.450959 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:24.451423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:24.452226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:24.452813 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:24.629439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:24.641479 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-625abb99-f981-41ed-9ce3-5154d945f232 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1674 microversion: 2.1 time: 0.201478 May 13 14:03:24.642271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 485/988] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:24 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:03:25.660586 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:25.661135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:25.668102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.668552 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.669550 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.669989 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.845275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:25.846008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:25.852787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.853355 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.854209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.854733 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.870662 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e HTTP/1.1 May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:25.872312 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.874127 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '4287d0fa-d950-4b22-abd9-d29601c0d86e'} May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:25.875492 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.876943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.878450 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:25.878550 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:25.878663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-19d0080e-9705-44ae-883c-1df7f8ae8f99 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 404 len: 111 microversion: 2.1 time: 0.034324 May 13 14:03:25.878663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 486/989] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:25 2022] DELETE /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:25.884397 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:25.885043 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 4287d0fa-d950-4b22-abd9-d29601c0d86e] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:25.885360 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-91c903aa-6476-4679-b2f2-23e35836cf00 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1674 microversion: 2.1 time: 0.229832 May 13 14:03:25.886136 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 504/990] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:25 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1674 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:25.894075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.894075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.894075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:25.894075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:25.914996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e HTTP/1.1 May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:25.916480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.917816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '4287d0fa-d950-4b22-abd9-d29601c0d86e'} May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:25.922020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. May 13 14:03:25.923615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:25.925005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 4287d0fa-d950-4b22-abd9-d29601c0d86e could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:25.925005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-81ad07ce-f535-4970-a695-030defd8b13f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e" status: 404 len: 111 microversion: 2.1 time: 0.037287 May 13 14:03:25.925005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 487/991] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:25 2022] GET /compute/v2.1/servers/4287d0fa-d950-4b22-abd9-d29601c0d86e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:03:26.406641 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-a13e4f5f-fb7f-4495-9640-93cd5353b265 req-def4eda2-3b71-40f6-9509-092edb1b1b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c92167-c104-47be-b2d9-394e84e49fd4", "name": "network-vif-deleted", "tag": "4577aed3-86f8-4344-99b2-fcdfb07f63a3"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:26.416208 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-a13e4f5f-fb7f-4495-9640-93cd5353b265 req-def4eda2-3b71-40f6-9509-092edb1b1b43 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.416658 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-a13e4f5f-fb7f-4495-9640-93cd5353b265 req-def4eda2-3b71-40f6-9509-092edb1b1b43 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.428940 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-a13e4f5f-fb7f-4495-9640-93cd5353b265 req-def4eda2-3b71-40f6-9509-092edb1b1b43 service nova] Creating event network-vif-deleted:4577aed3-86f8-4344-99b2-fcdfb07f63a3 for instance 94c92167-c104-47be-b2d9-394e84e49fd4 on hv-cinder-84175 May 13 14:03:26.434980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-a13e4f5f-fb7f-4495-9640-93cd5353b265 req-def4eda2-3b71-40f6-9509-092edb1b1b43 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033415 May 13 14:03:26.440731 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 505/992] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:26.903270 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:26.904872 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:26.913291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.914180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.915495 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.916175 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.952989 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:26.953718 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:26.954348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.objects.instance [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lazy-loading 'fault' on Instance uuid 94c92167-c104-47be-b2d9-394e84e49fd4 {{(pid=123511) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:03:27.004409 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a37f5d5ddd9845fbaf7d5645c31b2d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef87180052d643af940a8e2b4f21e46f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:03:27.012488 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-63be0964-339e-42f4-9237-502aacece404 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 200 len: 1328 microversion: 2.1 time: 0.112967 May 13 14:03:27.013142 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 488/993] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:26 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 1328 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:03:27.106478 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:27.107895 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:27.116748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.117208 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.118254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.118898 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.134349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 HTTP/1.1 May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:27.136091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.137851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '083c581f-911c-4e70-99f7-3ab188d35653'} May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:27.142456 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.144046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.145528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:27.145528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-8f1ac3c1-60ad-4a1d-b386-81ec27c0276f tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 404 len: 111 microversion: 2.1 time: 0.035924 May 13 14:03:27.145528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 506/994] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:27 2022] DELETE /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:27.147198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:27.147786 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 083c581f-911c-4e70-99f7-3ab188d35653] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:27.155907 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.156653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.158426 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.158426 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 HTTP/1.1 May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:27.183951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.186121 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '083c581f-911c-4e70-99f7-3ab188d35653'} May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:27.187555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. May 13 14:03:27.189308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.190561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 083c581f-911c-4e70-99f7-3ab188d35653 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:27.190561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-97698e48-fd0e-40fa-a795-aad00a501d34 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653" status: 404 len: 111 microversion: 2.1 time: 0.040442 May 13 14:03:27.190561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 489/995] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:27 2022] GET /compute/v2.1/servers/083c581f-911c-4e70-99f7-3ab188d35653 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:27.195100 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:27.195852 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:27.203779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.204298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.205089 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.205522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.220277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 HTTP/1.1 May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:27.221837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.223556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '1309a28e-544d-4d0d-a42e-4a5be1b1ddb6'} May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:27.224378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.225810 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:27.227090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:27.227090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c4b94b2f-1213-49ee-9726-28ba9e10d431 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 404 len: 111 microversion: 2.1 time: 0.032934 May 13 14:03:27.227090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 507/996] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:27 2022] DELETE /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:27.232644 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:27.233301 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:27.240309 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.240829 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.241566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:27.242004 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:27.257317 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 HTTP/1.1 May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:27.258904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.260499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '1309a28e-544d-4d0d-a42e-4a5be1b1ddb6'} May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:27.261420 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. May 13 14:03:27.262790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:27.264000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance 1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:27.264000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-54641d41-745c-46ab-abdb-406b2c977415 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6" status: 404 len: 111 microversion: 2.1 time: 0.031864 May 13 14:03:27.264000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 490/997] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:27 2022] GET /compute/v2.1/servers/1309a28e-544d-4d0d-a42e-4a5be1b1ddb6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:28.031525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:28.032319 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:28.038551 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:28.039027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:28.039798 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:28.040234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:28.054662 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] HTTP exception thrown: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Request method failure captured: May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 HTTP/1.1 May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmN6Zp-lfe_Gy2NLJo-KLXNSIHm5GcCzTMxLWvoQdslAzU3c8rYWe6uDHaDmkg1HUYeNk4VIFqEoTIVFEl3UWkKLbHygNSwcgQ4fNlBso6-sH0-ZKwlD5GNNbRjAmyKquqnJArtK3sMOyc8Nxs1SF2_VQvhpvZW5A51v68wHQ5yWp8I May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:28.056250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a37f5d5ddd9845fbaf7d5645c31b2d40 May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:28.058135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '94c92167-c104-47be-b2d9-394e84e49fd4'} May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:28.059476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:28.061432 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.063234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Returning 404 to user: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:28.063234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7c52682d-95fe-4c3b-8e00-f5d6114fdca2 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 404 len: 111 microversion: 2.1 time: 0.030614 May 13 14:03:28.063234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 508/998] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:28 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:28.069809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e43e40c7-85c0-4225-b365-e62702cd9a37 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '.version_select at 0x7fb3be2fc550>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:28.089477 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e43e40c7-85c0-4225-b365-e62702cd9a37 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672217952" status: 202 len: 0 microversion: 2.1 time: 0.024485 May 13 14:03:28.090049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 491/999] 10.222.0.79 () {58 vars in 1220 bytes} [Fri May 13 14:03:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672217952 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:28.414590 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:28.415753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:28.423089 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:28.423592 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:28.424433 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:28.424883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:28.441153 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a HTTP/1.1 May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:28.443075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.444742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'c5fb9024-5080-4527-b9ac-55f60dbccd8a'} May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:28.445715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.447687 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:28.452913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:28.452913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5cf6784d-ca0a-4ba7-b874-39be48cee2ed tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 404 len: 111 microversion: 2.1 time: 0.036203 May 13 14:03:28.452913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 509/1000] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:28 2022] DELETE /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:28.457824 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:28.458378 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] [instance: c5fb9024-5080-4527-b9ac-55f60dbccd8a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:28.465719 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:28.466365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:28.467640 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:28.468154 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:28.485921 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] HTTP exception thrown: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Request method failure captured: May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a HTTP/1.1 May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmNzFX0RNTuT_JDe-ph3uThZuUNPlHdC_iPGFdVJhdHfHBxeWxEZmCPnF1htWjhucQ9YUHcrQlbVC6b6EFs4iKV5oVDtDUR6XyVh6q3u9hIKDETTIAnWsK2rFgAQmBzuRKHdDneplnn4inNkgVtk3vjkRAfeyGYi7Vf9lx0lT1lGGSw May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:28.487863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ac9b3816e0cb4400919797c107065ad4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ac9b3816e0cb4400919797c107065ad4 May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1547213813 May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 648ae92126944b50a22ad780e92df914 May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeNegativeTest-1547213813-project May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.489384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'c5fb9024-5080-4527-b9ac-55f60dbccd8a'} May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:28.490204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. May 13 14:03:28.491708 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:28.492885 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] Returning 404 to user: Instance c5fb9024-5080-4527-b9ac-55f60dbccd8a could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:28.494233 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-129281e0-4a75-4c1a-8cf4-6541ae370135 tempest-AttachVolumeNegativeTest-1547213813 tempest-AttachVolumeNegativeTest-1547213813-project] 10.222.0.79 "GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a" status: 404 len: 111 microversion: 2.1 time: 0.039935 May 13 14:03:28.495079 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 492/1001] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:28 2022] GET /compute/v2.1/servers/c5fb9024-5080-4527-b9ac-55f60dbccd8a => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:31.127921 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:31.128534 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:31.135779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.136309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.137163 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.137669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.154019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] HTTP exception thrown: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Request method failure captured: May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 HTTP/1.1 May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmN6Zp-lfe_Gy2NLJo-KLXNSIHm5GcCzTMxLWvoQdslAzU3c8rYWe6uDHaDmkg1HUYeNk4VIFqEoTIVFEl3UWkKLbHygNSwcgQ4fNlBso6-sH0-ZKwlD5GNNbRjAmyKquqnJArtK3sMOyc8Nxs1SF2_VQvhpvZW5A51v68wHQ5yWp8I May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:31.156293 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a37f5d5ddd9845fbaf7d5645c31b2d40 May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.157991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '94c92167-c104-47be-b2d9-394e84e49fd4'} May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:31.158916 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.164474 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:31.165985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Returning 404 to user: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:31.165985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6407ef1e-5cb7-4d5f-b50c-ad65afd81357 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 404 len: 111 microversion: 2.1 time: 0.037150 May 13 14:03:31.165985 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 510/1002] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:31 2022] DELETE /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:31.170933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:31.172224 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 94c92167-c104-47be-b2d9-394e84e49fd4] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:31.180472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.181091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.181992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:31.182534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:31.198185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] HTTP exception thrown: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Request method failure captured: May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 HTTP/1.1 May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmN6Zp-lfe_Gy2NLJo-KLXNSIHm5GcCzTMxLWvoQdslAzU3c8rYWe6uDHaDmkg1HUYeNk4VIFqEoTIVFEl3UWkKLbHygNSwcgQ4fNlBso6-sH0-ZKwlD5GNNbRjAmyKquqnJArtK3sMOyc8Nxs1SF2_VQvhpvZW5A51v68wHQ5yWp8I May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:31.200394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: a37f5d5ddd9845fbaf7d5645c31b2d40 May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.202111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '94c92167-c104-47be-b2d9-394e84e49fd4'} May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:31.203670 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. May 13 14:03:31.205180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:31.206482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Returning 404 to user: Instance 94c92167-c104-47be-b2d9-394e84e49fd4 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:31.207245 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fbab319f-e12d-4452-ba7e-a54438b0acef tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4" status: 404 len: 111 microversion: 2.1 time: 0.042169 May 13 14:03:31.211158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 493/1003] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:31 2022] GET /compute/v2.1/servers/94c92167-c104-47be-b2d9-394e84e49fd4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:32.408426 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:32.410740 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:32.422310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.422984 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.423951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.424535 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.451112 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] HTTP exception thrown: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Request method failure captured: May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da HTTP/1.1 May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmN6Zp-lfe_Gy2NLJo-KLXNSIHm5GcCzTMxLWvoQdslAzU3c8rYWe6uDHaDmkg1HUYeNk4VIFqEoTIVFEl3UWkKLbHygNSwcgQ4fNlBso6-sH0-ZKwlD5GNNbRjAmyKquqnJArtK3sMOyc8Nxs1SF2_VQvhpvZW5A51v68wHQ5yWp8I May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:32.453777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a37f5d5ddd9845fbaf7d5645c31b2d40 May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.455549 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '596ea3e4-5857-40b2-82e2-84c63e19f7da'} May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:32.456444 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.457925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:32.460397 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Returning 404 to user: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:32.461561 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-240ab614-a11c-4b61-ab71-2783449b8ac1 tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 404 len: 111 microversion: 2.1 time: 0.061463 May 13 14:03:32.463183 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 511/1004] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:03:32 2022] DELETE /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:32.471110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:32.471745 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] [instance: 596ea3e4-5857-40b2-82e2-84c63e19f7da] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:03:32.479483 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.479938 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.480740 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:03:32.481452 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:03:32.509479 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] HTTP exception thrown: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Request method failure captured: May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da HTTP/1.1 May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmN6Zp-lfe_Gy2NLJo-KLXNSIHm5GcCzTMxLWvoQdslAzU3c8rYWe6uDHaDmkg1HUYeNk4VIFqEoTIVFEl3UWkKLbHygNSwcgQ4fNlBso6-sH0-ZKwlD5GNNbRjAmyKquqnJArtK3sMOyc8Nxs1SF2_VQvhpvZW5A51v68wHQ5yWp8I May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:32.511096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ef87180052d643af940a8e2b4f21e46f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ef87180052d643af940a8e2b4f21e46f May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1611101519 May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: a37f5d5ddd9845fbaf7d5645c31b2d40 May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeTestJSON-1611101519-project May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.512716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '596ea3e4-5857-40b2-82e2-84c63e19f7da'} May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:32.513790 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. May 13 14:03:32.515984 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:32.518173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] Returning 404 to user: Instance 596ea3e4-5857-40b2-82e2-84c63e19f7da could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:32.519075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-aed7c648-b0a1-47ac-8547-260e1e30e40f tempest-AttachVolumeTestJSON-1611101519 tempest-AttachVolumeTestJSON-1611101519-project] 10.222.0.79 "GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da" status: 404 len: 111 microversion: 2.1 time: 0.052818 May 13 14:03:32.538895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 494/1005] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:03:32 2022] GET /compute/v2.1/servers/596ea3e4-5857-40b2-82e2-84c63e19f7da => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:38.326605 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b0db4426-4c98-490a-adf4-8581d65e2f44 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Action: 'create', calling method: .version_select at 0x7fb3bdd5f550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-853843281"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:38.816041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b0db4426-4c98-490a-adf4-8581d65e2f44 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.611909 May 13 14:03:38.816764 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 512/1006] 10.222.0.79 () {60 vars in 1154 bytes} [Fri May 13 14:03:38 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 613 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 14:03:38.828961 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5bcc091d-2f9b-44f2-9c05-16a63d3e0a1d tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be62d670>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:38.894164 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5bcc091d-2f9b-44f2-9c05-16a63d3e0a1d tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 200 len: 344 microversion: 2.1 time: 0.069991 May 13 14:03:38.895190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 495/1007] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:03:38 2022] GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:39.907239 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4f5f5499-5102-49d8-a7ff-92b4b59f91ab tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdbaf790>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:39.966570 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4f5f5499-5102-49d8-a7ff-92b4b59f91ab tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 200 len: 345 microversion: 2.1 time: 0.063571 May 13 14:03:39.967179 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 513/1008] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:03:39 2022] GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 345 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:39.979092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4d6e0dff-a29b-4e55-a828-d7e2e08702cd tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Action: 'create', calling method: .version_select at 0x7fb3be47ef70>, body: {"snapshot": {"volume_id": "d0949718-83f6-4d5c-83e2-82f746d873c8", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-430144298"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:03:40.137489 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4d6e0dff-a29b-4e55-a828-d7e2e08702cd tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.162960 May 13 14:03:40.138078 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 496/1009] 10.222.0.79 () {60 vars in 1161 bytes} [Fri May 13 14:03:39 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:03:40.148789 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7425c756-1e55-45a6-a122-459f33aa41df tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdcd2940>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:40.181781 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7425c756-1e55-45a6-a122-459f33aa41df tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 200 len: 286 microversion: 2.1 time: 0.037630 May 13 14:03:40.190184 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 514/1010] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:40 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:40.195257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0b04a098-07b2-41c6-8e92-3543ba951f9c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be53a670>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:40.230354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0b04a098-07b2-41c6-8e92-3543ba951f9c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.038887 May 13 14:03:40.236017 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 497/1011] 10.222.0.79 () {58 vars in 1139 bytes} [Fri May 13 14:03:40 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:40.241286 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dd78d537-4cb2-4c8c-9d3e-9673b0c87a0c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdbbe3a0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:40.281059 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dd78d537-4cb2-4c8c-9d3e-9673b0c87a0c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 200 len: 286 microversion: 2.1 time: 0.042759 May 13 14:03:40.282552 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 515/1012] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:40 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:41.295374 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-67c9adc3-ec69-4c10-b16e-4529d16b5ab4 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be43dc10>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:41.325095 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-67c9adc3-ec69-4c10-b16e-4529d16b5ab4 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 200 len: 286 microversion: 2.1 time: 0.034005 May 13 14:03:41.325795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 498/1013] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:41 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:42.337235 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0068a112-0e32-46cc-ac74-4ec1fc0815c6 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdc02f70>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:42.368043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0068a112-0e32-46cc-ac74-4ec1fc0815c6 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 200 len: 286 microversion: 2.1 time: 0.035046 May 13 14:03:42.368615 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 516/1014] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:42 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:43.384576 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cb0d4d33-944f-42bf-9a07-6d7cec982c76 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be5e75e0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.418314 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cb0d4d33-944f-42bf-9a07-6d7cec982c76 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 200 len: 287 microversion: 2.1 time: 0.041793 May 13 14:03:43.418938 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 499/1015] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:43 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:43.430986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ce246a7d-1f8c-480d-8643-38aa9ece7a7b tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdc63af0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.517038 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ce246a7d-1f8c-480d-8643-38aa9ece7a7b tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "DELETE /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 202 len: 0 microversion: 2.1 time: 0.090738 May 13 14:03:43.521887 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 517/1016] 10.222.0.79 () {58 vars in 1253 bytes} [Fri May 13 14:03:43 2022] DELETE /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:43.526806 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4da9f77f-65f6-4b19-af97-d79784152a30 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be60cdc0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:43.560602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4da9f77f-65f6-4b19-af97-d79784152a30 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 200 len: 286 microversion: 2.1 time: 0.037519 May 13 14:03:43.561272 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 500/1017] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:43 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:44.573362 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5834fca0-edfb-420d-9595-53f40b0c0b8c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdc7ea60>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:44.614581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-5834fca0-edfb-420d-9595-53f40b0c0b8c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] HTTP exception thrown: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5834fca0-edfb-420d-9595-53f40b0c0b8c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Request method failure captured: May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d HTTP/1.1 May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmU6PoKKsp2JyjrN19tEqkZ-3KQ5TskGcPyADRlwnbzP__qwkl7xWGNb8rBMhk1ztIOkVntwpsINX9UULhBriUJELM1tUIoZcVNLMQifaCGL5yVl7fBkfqvfBjSXnMLrMd08-5xp6K40v1J6_PMOegTk3kyfOfRc1LzxtjtiBhZOycw May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:44.617084 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 10d7a3891aa244508dd55484ebb235cb May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'd6400af8-930a-4d72-a384-e13a25d1f62d'} May 13 14:03:44.619578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. (HTTP 404) (Request-ID: req-634c1751-4818-45e9-aa4e-29fe270cdbe8) May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.621161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:03:44.624627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 14:03:44.628251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5834fca0-edfb-420d-9595-53f40b0c0b8c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Returning 404 to user: Snapshot d6400af8-930a-4d72-a384-e13a25d1f62d could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5834fca0-edfb-420d-9595-53f40b0c0b8c tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d" status: 404 len: 111 microversion: 2.1 time: 0.049484 May 13 14:03:44.634296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 518/1018] 10.222.0.79 () {58 vars in 1250 bytes} [Fri May 13 14:03:44 2022] GET /compute/v2.1/os-snapshots/d6400af8-930a-4d72-a384-e13a25d1f62d => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:44.638523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-df83b5ef-8614-472d-b152-46bf968d7fe7 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be5e7430>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:44.725939 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-df83b5ef-8614-472d-b152-46bf968d7fe7 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 202 len: 0 microversion: 2.1 time: 0.095793 May 13 14:03:44.727388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 501/1019] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 14:03:44 2022] DELETE /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:03:44.736491 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-06a00e33-1d04-4dd2-add1-878f33999f30 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdeb84c0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:44.817879 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-06a00e33-1d04-4dd2-add1-878f33999f30 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 200 len: 344 microversion: 2.1 time: 0.085443 May 13 14:03:44.819118 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 519/1020] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:03:44 2022] GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:03:45.833042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0a568308-772e-45e0-8374-aa92e3f03a5f tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be66eee0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:45.870747 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-0a568308-772e-45e0-8374-aa92e3f03a5f tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] HTTP exception thrown: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0a568308-772e-45e0-8374-aa92e3f03a5f tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Request method failure captured: May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 HTTP/1.1 May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmU6PoKKsp2JyjrN19tEqkZ-3KQ5TskGcPyADRlwnbzP__qwkl7xWGNb8rBMhk1ztIOkVntwpsINX9UULhBriUJELM1tUIoZcVNLMQifaCGL5yVl7fBkfqvfBjSXnMLrMd08-5xp6K40v1J6_PMOegTk3kyfOfRc1LzxtjtiBhZOycw May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:45.872837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 10d7a3891aa244508dd55484ebb235cb May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'd0949718-83f6-4d5c-83e2-82f746d873c8'} May 13 14:03:45.875190 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. (HTTP 404) (Request-ID: req-b63687de-b7ec-4d2b-8cb2-a857d8b0d4f4) May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.876360 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:03:45.877887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:03:45.879461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0a568308-772e-45e0-8374-aa92e3f03a5f tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Returning 404 to user: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:45.880770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0a568308-772e-45e0-8374-aa92e3f03a5f tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 404 len: 109 microversion: 2.1 time: 0.045094 May 13 14:03:45.887293 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 502/1021] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:03:45 2022] GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:45.897992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0609697f-604d-439f-8c48-dae6c8e1d580 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3bdbbe160>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:45.935907 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-0609697f-604d-439f-8c48-dae6c8e1d580 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] HTTP exception thrown: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0609697f-604d-439f-8c48-dae6c8e1d580 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Request method failure captured: May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 HTTP/1.1 May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmU6PoKKsp2JyjrN19tEqkZ-3KQ5TskGcPyADRlwnbzP__qwkl7xWGNb8rBMhk1ztIOkVntwpsINX9UULhBriUJELM1tUIoZcVNLMQifaCGL5yVl7fBkfqvfBjSXnMLrMd08-5xp6K40v1J6_PMOegTk3kyfOfRc1LzxtjtiBhZOycw May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:03:45.940582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 10d7a3891aa244508dd55484ebb235cb May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'd0949718-83f6-4d5c-83e2-82f746d873c8'} May 13 14:03:45.942238 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. (HTTP 404) (Request-ID: req-2b158eb4-4ef8-4809-9ee6-141d195d8095) May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.943277 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 14:03:45.945185 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 14:03:45.946861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0609697f-604d-439f-8c48-dae6c8e1d580 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Returning 404 to user: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0609697f-604d-439f-8c48-dae6c8e1d580 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 404 len: 109 microversion: 2.1 time: 0.057169 May 13 14:03:45.951544 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 520/1022] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 14:03:45 2022] DELETE /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:03:45.959261 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-097f1b7f-9c4a-457b-9c8c-d88c3e5fc199 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Calling method '.version_select at 0x7fb3be644820>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:03:45.991628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-097f1b7f-9c4a-457b-9c8c-d88c3e5fc199 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] HTTP exception thrown: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-097f1b7f-9c4a-457b-9c8c-d88c3e5fc199 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Request method failure captured: May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 HTTP/1.1 May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmU6PoKKsp2JyjrN19tEqkZ-3KQ5TskGcPyADRlwnbzP__qwkl7xWGNb8rBMhk1ztIOkVntwpsINX9UULhBriUJELM1tUIoZcVNLMQifaCGL5yVl7fBkfqvfBjSXnMLrMd08-5xp6K40v1J6_PMOegTk3kyfOfRc1LzxtjtiBhZOycw May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:03:45.993760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_9eb67099abec43c59e2aa5fe2f0920ab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 9eb67099abec43c59e2aa5fe2f0920ab May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-84026221 May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 10d7a3891aa244508dd55484ebb235cb May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesSnapshotsTestJSON-84026221-project May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'd0949718-83f6-4d5c-83e2-82f746d873c8'} May 13 14:03:45.995277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. (HTTP 404) (Request-ID: req-55454cde-1f03-4ca9-b0b8-3f5232bad195) May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.996093 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:03:45.997257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:03:45.998384 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-097f1b7f-9c4a-457b-9c8c-d88c3e5fc199 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] Returning 404 to user: Volume d0949718-83f6-4d5c-83e2-82f746d873c8 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-097f1b7f-9c4a-457b-9c8c-d88c3e5fc199 tempest-VolumesSnapshotsTestJSON-84026221 tempest-VolumesSnapshotsTestJSON-84026221-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8" status: 404 len: 109 microversion: 2.1 time: 0.041300 May 13 14:03:46.001296 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 503/1023] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:03:45 2022] GET /compute/v2.1/os-volumes/d0949718-83f6-4d5c-83e2-82f746d873c8 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:04:01.632995 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:01.634526 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:01.641445 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.641988 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.642855 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.643284 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.676731 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-542322e4-3ff8-426a-a061-0226f46bfe9c tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048410 May 13 14:04:01.677320 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 521/1024] 10.222.0.79 () {60 vars in 1342 bytes} [Fri May 13 14:04:01 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:01.741250 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:01.741737 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:01.748946 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.749396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.750198 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.750638 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.777094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:04:01.879039 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4f325ae7-38d5-461e-a9a1-67fa9cd45f48 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 204 len: 0 microversion: 2.20 time: 0.143178 May 13 14:04:01.879967 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 504/1025] 10.222.0.79 () {60 vars in 1279 bytes} [Fri May 13 14:04:01 2022] DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 14:04:01.888980 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:01.889683 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:01.903596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.904190 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:01.904997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:01.905442 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:02.064818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:02.074613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:02.076866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:02.079110 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ccfb0690-fd27-4918-9fe3-b51cacc620f1 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.193912 May 13 14:04:02.079690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 522/1026] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:01 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:04:03.107249 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:03.108011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:03.118541 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:03.119019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:03.119819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:03.120365 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:03.275893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:03.286639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:03.288195 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:03.289385 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6356e116-c43c-4177-938a-795696227afb tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.188768 May 13 14:04:03.289951 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 505/1027] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:03 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:04:04.308734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:04.309350 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:04.316267 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:04.316723 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:04.317524 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:04.317960 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:04.738460 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:04.748230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:04.750343 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:04.751994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ace90eac-43d7-4f90-a70c-19579818d0e3 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.447288 May 13 14:04:04.752604 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 523/1028] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:04 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:04:05.774055 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:05.775011 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:05.786829 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:05.787566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:05.788992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:05.789787 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:05.989139 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:05.997953 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:06.000429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:06.001871 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b2a70be7-f934-4b42-81b0-8a877bda222d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1724 microversion: 2.20 time: 0.235215 May 13 14:04:06.002447 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 506/1029] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:05 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1724 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:04:07.025619 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:07.027344 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:07.037332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:07.038242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:07.039657 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:07.040558 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:07.168787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:07.178986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:07.182493 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:07.183655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c7be8cfe-1756-4793-851e-08f086108428 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1656 microversion: 2.20 time: 0.165507 May 13 14:04:07.185121 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 524/1030] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:07 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1656 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 14:04:07.601512 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-ac735ab2-7cab-4884-a6f8-7e8d1ef208ea req-9aa50d91-bb11-480f-a9a3-065df9fe4a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "724a12c7-721b-4152-b296-d2404b24443c", "name": "network-vif-deleted", "tag": "64446a02-9540-4f0f-8e1e-fe054859b8ee"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:07.629276 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-ac735ab2-7cab-4884-a6f8-7e8d1ef208ea req-9aa50d91-bb11-480f-a9a3-065df9fe4a41 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:07.629751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-ac735ab2-7cab-4884-a6f8-7e8d1ef208ea req-9aa50d91-bb11-480f-a9a3-065df9fe4a41 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:07.701566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-ac735ab2-7cab-4884-a6f8-7e8d1ef208ea req-9aa50d91-bb11-480f-a9a3-065df9fe4a41 service nova] Creating event network-vif-deleted:64446a02-9540-4f0f-8e1e-fe054859b8ee for instance 724a12c7-721b-4152-b296-d2404b24443c on hv-cinder-84175 May 13 14:04:07.723259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-ac735ab2-7cab-4884-a6f8-7e8d1ef208ea req-9aa50d91-bb11-480f-a9a3-065df9fe4a41 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126498 May 13 14:04:07.724304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 507/1031] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:04:08.205514 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:08.214600 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:08.233046 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.233494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.238788 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.239427 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.557678 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:08.558189 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:08.558650 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lazy-loading 'fault' on Instance uuid 724a12c7-721b-4152-b296-d2404b24443c {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:04:08.630953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:08.640572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:08.642500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8b2980196e0f4fafa5131dd5de02ac75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '203eb74b5a2c444aac67940d775ecfc3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:08.643873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-931de697-9543-473c-8901-6134bfa4a37d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 200 len: 1371 microversion: 2.20 time: 0.443969 May 13 14:04:08.644365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 525/1032] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:08 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 1371 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 14:04:09.670208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:09.672239 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:09.679726 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:09.680304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:09.681276 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:09.681709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:09.702639 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] HTTP exception thrown: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Request method failure captured: May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c HTTP/1.1 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOA0ENgZfmI7hdGswBi5wrsxt9VVtbOaySS7Jasg0ZX37yN8k6upyCDPYTAa5ZYfNW2vbP2A21qgbRdDKXXxvW78_oI1KTgrL4MxxlQTy48hKbHWi_f9QHuUB4nR11N-Nb4DvDaO2ws_ibPVk6DCtUsYg_cP3a2H8LRyEyQTk-eHxE May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:04:09.704387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 8b2980196e0f4fafa5131dd5de02ac75 May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:09.705922 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '724a12c7-721b-4152-b296-d2404b24443c'} May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:04:09.706757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:09.708339 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:09.709591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Returning 404 to user: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:04:09.709591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1b82ea2d-030e-4317-a455-dbfd92f3321b tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 404 len: 111 microversion: 2.20 time: 0.042184 May 13 14:04:09.709591 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 508/1033] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:09 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:04:09.719593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-48bbf2af-c39b-4f8c-89c6-6dbd95f00386 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '.version_select at 0x7fb3bdbd19d0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:09.750024 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-48bbf2af-c39b-4f8c-89c6-6dbd95f00386 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-281751675" status: 204 len: 0 microversion: 2.20 time: 0.035660 May 13 14:04:09.750616 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 526/1034] 10.222.0.79 () {60 vars in 1258 bytes} [Fri May 13 14:04:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-281751675 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 13 14:04:11.790284 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:11.791091 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:11.804094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:11.805082 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:11.806550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:11.807428 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:11.844256 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] HTTP exception thrown: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Request method failure captured: May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c HTTP/1.1 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOA0ENgZfmI7hdGswBi5wrsxt9VVtbOaySS7Jasg0ZX37yN8k6upyCDPYTAa5ZYfNW2vbP2A21qgbRdDKXXxvW78_oI1KTgrL4MxxlQTy48hKbHWi_f9QHuUB4nR11N-Nb4DvDaO2ws_ibPVk6DCtUsYg_cP3a2H8LRyEyQTk-eHxE May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:04:11.847619 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 8b2980196e0f4fafa5131dd5de02ac75 May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.849780 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '724a12c7-721b-4152-b296-d2404b24443c'} May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:04:11.850703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.852042 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:11.853503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Returning 404 to user: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:04:11.853503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f8060831-0053-4d3a-a928-090d991e0fc6 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 404 len: 111 microversion: 2.20 time: 0.066842 May 13 14:04:11.853503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 509/1035] 10.222.0.79 () {60 vars in 1279 bytes} [Fri May 13 14:04:11 2022] DELETE /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:04:11.862907 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:11.863591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 724a12c7-721b-4152-b296-d2404b24443c] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:11.874336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:11.875760 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:11.877242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:11.878027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:11.903923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] HTTP exception thrown: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Request method failure captured: May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c HTTP/1.1 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmOA0ENgZfmI7hdGswBi5wrsxt9VVtbOaySS7Jasg0ZX37yN8k6upyCDPYTAa5ZYfNW2vbP2A21qgbRdDKXXxvW78_oI1KTgrL4MxxlQTy48hKbHWi_f9QHuUB4nR11N-Nb4DvDaO2ws_ibPVk6DCtUsYg_cP3a2H8LRyEyQTk-eHxE May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:04:11.906170 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 8b2980196e0f4fafa5131dd5de02ac75 May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.908301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '724a12c7-721b-4152-b296-d2404b24443c'} May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:04:11.909518 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. May 13 14:04:11.911162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:11.912757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Returning 404 to user: Instance 724a12c7-721b-4152-b296-d2404b24443c could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:04:11.912757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0761bf6a-c2db-44fb-944d-88d70bdb693d tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c" status: 404 len: 111 microversion: 2.20 time: 0.050622 May 13 14:04:11.912757 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 527/1036] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:11 2022] GET /compute/v2.1/servers/724a12c7-721b-4152-b296-d2404b24443c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:04:13.103852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:13.110413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:13.118319 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:13.121513 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:13.122651 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:13.125588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:13.142966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] HTTP exception thrown: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Request method failure captured: May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 HTTP/1.1 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmOA0ENgZfmI7hdGswBi5wrsxt9VVtbOaySS7Jasg0ZX37yN8k6upyCDPYTAa5ZYfNW2vbP2A21qgbRdDKXXxvW78_oI1KTgrL4MxxlQTy48hKbHWi_f9QHuUB4nR11N-Nb4DvDaO2ws_ibPVk6DCtUsYg_cP3a2H8LRyEyQTk-eHxE May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:04:13.148809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 8b2980196e0f4fafa5131dd5de02ac75 May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.151180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': '19b01326-65de-403a-8020-724b6563fa64'} May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:04:13.157425 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.160096 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:13.162657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Returning 404 to user: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:04:13.162657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ee779b0a-b914-48aa-bc8f-6cf82d2057bf tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 404 len: 111 microversion: 2.20 time: 0.051453 May 13 14:04:13.162657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 510/1037] 10.222.0.79 () {60 vars in 1279 bytes} [Fri May 13 14:04:13 2022] DELETE /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:04:13.164570 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:13.165250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] [instance: 19b01326-65de-403a-8020-724b6563fa64] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:13.174192 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:13.174192 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:13.181119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:13.181119 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] HTTP exception thrown: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Request method failure captured: May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 HTTP/1.1 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmOA0ENgZfmI7hdGswBi5wrsxt9VVtbOaySS7Jasg0ZX37yN8k6upyCDPYTAa5ZYfNW2vbP2A21qgbRdDKXXxvW78_oI1KTgrL4MxxlQTy48hKbHWi_f9QHuUB4nR11N-Nb4DvDaO2ws_ibPVk6DCtUsYg_cP3a2H8LRyEyQTk-eHxE May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Openstack-Nova-Api-Version: 2.20 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:04:13.202931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_203eb74b5a2c444aac67940d775ecfc3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 203eb74b5a2c444aac67940d775ecfc3 May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1986208347 May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 8b2980196e0f4fafa5131dd5de02ac75 May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1986208347-project May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.204529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '19b01326-65de-403a-8020-724b6563fa64'} May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:04:13.205387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. May 13 14:04:13.206857 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:04:13.208063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] Returning 404 to user: Instance 19b01326-65de-403a-8020-724b6563fa64 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:04:13.208063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3f9149c8-4a9b-47f6-a8fc-967289d61dc5 tempest-AttachVolumeShelveTestJSON-1986208347 tempest-AttachVolumeShelveTestJSON-1986208347-project] 10.222.0.79 "GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64" status: 404 len: 111 microversion: 2.20 time: 0.037499 May 13 14:04:13.208063 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 528/1038] 10.222.0.79 () {60 vars in 1276 bytes} [Fri May 13 14:04:13 2022] GET /compute/v2.1/servers/19b01326-65de-403a-8020-724b6563fa64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 14:04:23.359330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b7b1bb1c-4e3f-46b8-ae73-ebbccf057d11 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Action: 'create', calling method: .version_select at 0x7fb3be644e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1803873347", "metadata": {"Type": "work"}}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:24.063313 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b7b1bb1c-4e3f-46b8-ae73-ebbccf057d11 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.411423 May 13 14:04:24.086400 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 511/1039] 10.222.0.79 () {60 vars in 1155 bytes} [Fri May 13 14:04:22 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1435 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 14:04:24.088253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-993503c9-98ed-409b-9689-c2911816a61c tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Calling method '.version_select at 0x7fb3bdbd1d30>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:24.286753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-993503c9-98ed-409b-9689-c2911816a61c tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42" status: 200 len: 353 microversion: 2.1 time: 0.209967 May 13 14:04:24.287459 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 529/1040] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:04:24 2022] GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:25.314908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ba59b1d2-3b24-45c9-8b7b-a1df4362c7c0 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Calling method '.version_select at 0x7fb3be77c670>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:25.402692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ba59b1d2-3b24-45c9-8b7b-a1df4362c7c0 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42" status: 200 len: 354 microversion: 2.1 time: 0.102309 May 13 14:04:25.410439 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 512/1041] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:04:25 2022] GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:25.418975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-00f507d0-17c0-45cb-9cb7-2d0502084677 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Calling method '.version_select at 0x7fb3bdbbe3a0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:25.498027 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-00f507d0-17c0-45cb-9cb7-2d0502084677 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42" status: 200 len: 354 microversion: 2.1 time: 0.084830 May 13 14:04:25.499036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 530/1042] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:04:25 2022] GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:25.526176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-48359ed2-f24f-4346-8cb2-86992cdab0ad tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Calling method '.version_select at 0x7fb3be66e8b0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:25.623661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-48359ed2-f24f-4346-8cb2-86992cdab0ad tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "DELETE /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42" status: 202 len: 0 microversion: 2.1 time: 0.102791 May 13 14:04:25.625006 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 513/1043] 10.222.0.79 () {58 vars in 1247 bytes} [Fri May 13 14:04:25 2022] DELETE /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:04:25.635378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-e86725bf-eb03-4fd1-803a-6b2b3a4022a1 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Calling method '.version_select at 0x7fb3bdbc1430>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:25.741940 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-e86725bf-eb03-4fd1-803a-6b2b3a4022a1 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42" status: 200 len: 353 microversion: 2.1 time: 0.110517 May 13 14:04:25.742930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 531/1044] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:04:25 2022] GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:26.760645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ca4f55a0-f8cc-4e87-aba1-26936b5ce250 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Calling method '.version_select at 0x7fb3be678e50>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:26.833033 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-ca4f55a0-f8cc-4e87-aba1-26936b5ce250 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] HTTP exception thrown: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ca4f55a0-f8cc-4e87-aba1-26936b5ce250 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Request method failure captured: May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 HTTP/1.1 May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmVmvDfDKRhNaL0etCkQsfzgHZeXQn6nJLEesfxSgxULhb9OYfWPI13ovNQil0w-QbOsYDnNtUGhV3zocNxKUK1Eo1N5TNiAgeeHvG6Hn5_Bg1GRyxWr2uO3M9_K4OyouArhRh1UoMa8ju_vUtT1fOELcAonJDiOs8r2nUeq50cTuFU May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: f6e66a5c52a440f6b64881277a23328c May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesGetTestJSON-1707008271 May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:04:26.835768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f6e66a5c52a440f6b64881277a23328c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/f6e66a5c52a440f6b64881277a23328c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/f6e66a5c52a440f6b64881277a23328c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_f6e66a5c52a440f6b64881277a23328c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesGetTestJSON-1707008271 May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: f6e66a5c52a440f6b64881277a23328c May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesGetTestJSON-1707008271 May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesGetTestJSON-1707008271-project May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: f9b67061bf654460a19409dc1ec93b76 May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesGetTestJSON-1707008271-project May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'ebad46f8-7c5c-4067-b366-4a61e581be42'} May 13 14:04:26.838615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. (HTTP 404) (Request-ID: req-f7acd479-219a-4f76-bb74-fcd921995241) May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:26.840982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 14:04:26.844228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 14:04:26.848621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ca4f55a0-f8cc-4e87-aba1-26936b5ce250 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] Returning 404 to user: Volume ebad46f8-7c5c-4067-b366-4a61e581be42 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ca4f55a0-f8cc-4e87-aba1-26936b5ce250 tempest-VolumesGetTestJSON-1707008271 tempest-VolumesGetTestJSON-1707008271-project] 10.222.0.79 "GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42" status: 404 len: 109 microversion: 2.1 time: 0.084924 May 13 14:04:26.855132 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 514/1045] 10.222.0.79 () {58 vars in 1244 bytes} [Fri May 13 14:04:26 2022] GET /compute/v2.1/os-volumes/ebad46f8-7c5c-4067-b366-4a61e581be42 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 14:04:47.790609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4449f19b-b16e-4b33-bca0-faf263212af8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Action: 'create', calling method: .version_select at 0x7fb3bdbd1280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-505401172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2/HcTj3CP5z47D5fooGMzUqYJpHPqqwgFzyRXAgrHs8lJ8C2p8YuG3H/JAgIl3SwLg8wcEQZv6IsEB9Wt5JbrvZY3Gdv3q3VzIPbQWheXdVP3Oi/ywwAqKz0X3aF0EVw=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:47.807352 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4449f19b-b16e-4b33-bca0-faf263212af8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Getting quotas for project 673435f01c47460bae84e4f31643f66d. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:04:47.812840 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4449f19b-b16e-4b33-bca0-faf263212af8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Getting quotas for user 3bbfb51ebb5f4553a9ef7b70becf1a9a and project 673435f01c47460bae84e4f31643f66d. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:04:47.838016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4449f19b-b16e-4b33-bca0-faf263212af8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.059944 May 13 14:04:47.838815 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 532/1046] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 14:04:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:04:48.038845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1156098444", "imageRef": "be9ae72a-9459-4d90-aeba-b507656d0ef0", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-505401172", "networks": [{"uuid": "b1642e0f-e0a0-4b6b-99e7-c73c07b51b14"}]}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:04:48.147265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.network.neutron [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] validate_networks() for [('b1642e0f-e0a0-4b6b-99e7-c73c07b51b14', None, None, None, None, None)] {{(pid=123511) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:04:48.869141 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Flavor limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:04:48.869593 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Image limits 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:04:48.870215 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Flavor pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:04:48.870622 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Image pref 0:0:0 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:04:48.871085 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.virt.hardware [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123511) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:04:48.880292 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:48.880891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:48.881725 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:48.882161 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:48.899948 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Getting quotas for project 673435f01c47460bae84e4f31643f66d. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:04:48.904249 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.quota [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Getting quotas for user 3bbfb51ebb5f4553a9ef7b70becf1a9a and project 673435f01c47460bae84e4f31643f66d. Resources: {'ram', 'cores', 'instances'} {{(pid=123511) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:04:48.925530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Going to run 1 instances... {{(pid=123511) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:04:48.927830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='be9ae72a-9459-4d90-aeba-b507656d0ef0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123511) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:04:48.978553 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8ec78378-5989-4610-8322-946725c369c6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.946593 May 13 14:04:48.979283 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 515/1047] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:04:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:04:48.995274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fb018843-c0f1-4b05-90bf-f0374064a006 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:48.996489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fb018843-c0f1-4b05-90bf-f0374064a006 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:49.063689 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fb018843-c0f1-4b05-90bf-f0374064a006 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:49.072850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fb018843-c0f1-4b05-90bf-f0374064a006 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1258 microversion: 2.1 time: 0.081950 May 13 14:04:49.072850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 533/1048] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:48 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1258 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:50.088967 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:50.089703 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:50.095829 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:50.096275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:50.097087 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:50.097532 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:50.166874 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:50.175472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d7e67a2c-c8a1-42a3-ae3e-8676a7bbdf57 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1310 microversion: 2.1 time: 0.090896 May 13 14:04:50.176064 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 516/1049] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:50 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:51.195040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:51.195670 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:51.214855 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:51.216746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:51.221169 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:51.222101 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:51.421051 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:51.458041 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3e73c779-9d02-48c7-8dc3-002c9263deba tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1316 microversion: 2.1 time: 0.269200 May 13 14:04:51.467421 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 534/1050] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:51 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:04:52.477098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:52.477645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:52.492024 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:52.492457 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:52.493269 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:52.493702 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:52.764791 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:52.776893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1a69731d-5495-499b-a6b6-a33ed721258a tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.304818 May 13 14:04:52.777686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 517/1051] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:52 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:53.793596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:53.794882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:53.802022 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:53.802469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:53.803495 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:53.804134 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:54.017234 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:54.025674 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ff296a05-2bd5-4c8a-bcee-365e61322c9b tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.235823 May 13 14:04:54.026741 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 535/1052] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:53 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:55.043392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:55.043976 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:55.065631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:55.065631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:55.065631 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:55.078648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:55.343325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:55.362111 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-90029c85-fe24-471f-94d5-670af7045f17 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.323433 May 13 14:04:55.379431 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 518/1053] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:55 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:56.388541 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:56.389280 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:56.396273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:56.397093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:56.398207 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:56.398991 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:56.657461 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:56.672276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-19eca7a7-cf6a-4db9-b4f3-27660b506e58 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.287372 May 13 14:04:56.672905 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 536/1054] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:56 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:57.697098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:57.697098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:57.703437 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:57.704714 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:57.705227 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:57.705714 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:57.971612 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:57.990234 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5e2ce13c-5c57-40fa-bb94-fdbeb6618ad2 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.300426 May 13 14:04:57.991731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 519/1055] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:57 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:04:59.008573 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:04:59.009758 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:04:59.016708 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:59.017537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:59.018325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:04:59.018787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:04:59.302591 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:04:59.316481 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-56e5c3a6-2b95-4fee-a1a2-0038ba6f20b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.311309 May 13 14:04:59.318074 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 537/1056] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:04:59 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:00.003486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-27f7df89-d54f-47f8-9856-61f825041df6 req-9bcde489-2b81-4dfa-bbb4-da635cc7efaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:00.024510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-27f7df89-d54f-47f8-9856-61f825041df6 req-9bcde489-2b81-4dfa-bbb4-da635cc7efaf service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:00.025285 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-27f7df89-d54f-47f8-9856-61f825041df6 req-9bcde489-2b81-4dfa-bbb4-da635cc7efaf service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:00.049244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-27f7df89-d54f-47f8-9856-61f825041df6 req-9bcde489-2b81-4dfa-bbb4-da635cc7efaf service nova] Creating event network-changed:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:05:00.056535 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-27f7df89-d54f-47f8-9856-61f825041df6 req-9bcde489-2b81-4dfa-bbb4-da635cc7efaf service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065150 May 13 14:05:00.057157 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 520/1057] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:05:00.337902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:00.350489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:00.370359 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:00.377389 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:00.378452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:00.378925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:00.599738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:00.607085 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-093adff1-b81e-4845-bb18-ba8afb02f863 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.275785 May 13 14:05:00.607667 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 538/1058] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:00 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:01.625893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:01.626692 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:01.633194 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:01.633783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:01.634667 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:01.635328 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:01.916697 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:01.926689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f3e96e44-5798-4884-94d8-ac632a962c48 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.306436 May 13 14:05:01.927338 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 521/1059] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:01 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:02.944420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:02.945040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:02.952261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:02.952790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:02.953727 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:02.954251 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:03.139747 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:03.149692 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-479741f5-94e3-42f9-ad0b-3b68256529d6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.209818 May 13 14:05:03.150263 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 539/1060] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:02 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:04.169866 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:04.170499 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:04.178226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:04.178675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:04.179503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:04.179923 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:04.224390 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1117419925", "imageRef": "fca35e28-aa07-4122-ae9b-257d60d09894", "flavorRef": "452"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:04.287887 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] validate_networks() for None {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:05:04.486120 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:04.495007 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a261102b-3d43-4750-abc7-30a516669810 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.328583 May 13 14:05:04.509868 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 522/1061] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:04 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:05:04.649230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:05:04.649655 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:05:04.650129 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:05:04.650536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:05:04.650986 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:05:04.660564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:04.661011 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:04.661818 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:04.662256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:04.679832 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Getting quotas for project ed183118dd8c4a84a96cc1cdc92d3a7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:05:04.683946 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Getting quotas for user 6ea439eafe224df0bd7fb46b6785e09b and project ed183118dd8c4a84a96cc1cdc92d3a7a. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:05:04.695036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:05:04.697325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fca35e28-aa07-4122-ae9b-257d60d09894',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:05:04.745961 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9d1e8ac7-6dca-406d-bd0e-be499b06b9b0 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.525823 May 13 14:05:04.751944 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 540/1062] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:05:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 534 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 14:05:04.756979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5de2ca35-72ae-4d1d-84c0-c84bf5aaf668 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:04.757638 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5de2ca35-72ae-4d1d-84c0-c84bf5aaf668 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:04.815247 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5de2ca35-72ae-4d1d-84c0-c84bf5aaf668 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:04.823056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5de2ca35-72ae-4d1d-84c0-c84bf5aaf668 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1215 microversion: 2.1 time: 0.069912 May 13 14:05:04.823661 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 523/1063] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:04 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:05.522117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:05.522676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:05.529939 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:05.530400 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:05.531329 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:05.531773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:05.678316 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:05.689780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b23714a6-015c-4c9f-bce6-bee03f972162 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.171674 May 13 14:05:05.690374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 541/1064] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:05 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:05.840309 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:05.840895 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:05.854196 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:05.854634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:05.855453 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:05.855896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:06.001064 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:06.010376 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0edbeacc-e961-4dd5-aa46-3ff25528a25f tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1285 microversion: 2.1 time: 0.173908 May 13 14:05:06.011176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 524/1065] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:05 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1285 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:06.067816 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-225d7028-0c0f-4b2e-8e3c-7cf6a1853058 req-c8e9f857-e566-4bb4-b767-c458b07e6b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "name": "network-vif-plugged", "status": "completed", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:06.076761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-225d7028-0c0f-4b2e-8e3c-7cf6a1853058 req-c8e9f857-e566-4bb4-b767-c458b07e6b69 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:06.077220 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-225d7028-0c0f-4b2e-8e3c-7cf6a1853058 req-c8e9f857-e566-4bb4-b767-c458b07e6b69 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:06.089877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-225d7028-0c0f-4b2e-8e3c-7cf6a1853058 req-c8e9f857-e566-4bb4-b767-c458b07e6b69 service nova] Creating event network-vif-plugged:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:05:06.095610 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-225d7028-0c0f-4b2e-8e3c-7cf6a1853058 req-c8e9f857-e566-4bb4-b767-c458b07e6b69 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031798 May 13 14:05:06.096223 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 542/1066] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:05:06.708002 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:06.708624 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:06.719118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:06.719683 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:06.720636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:06.721087 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:06.876816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:06.884657 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c20810ed-2075-4e1d-8da5-e223413accd5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1358 microversion: 2.1 time: 0.181592 May 13 14:05:06.885244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 525/1067] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:06 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:07.032348 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:07.033068 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:07.039270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:07.039728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:07.040515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:07.040956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:07.261813 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:07.269278 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-74ff038f-be19-4778-b0b9-9f7628247a87 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.244300 May 13 14:05:07.269866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 543/1068] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:07 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:07.823534 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-57f44e9d-7a3f-41a7-a6f5-867504ce5b3a req-9e699fe1-e822-482f-9a6a-f6ac7379e5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d80a17c8-1887-4a66-8973-36998354c405", "tag": "fd2ef2ce-507a-467b-8b2a-376bcbddebb0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:07.833182 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-57f44e9d-7a3f-41a7-a6f5-867504ce5b3a req-9e699fe1-e822-482f-9a6a-f6ac7379e5ea service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:07.833956 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-57f44e9d-7a3f-41a7-a6f5-867504ce5b3a req-9e699fe1-e822-482f-9a6a-f6ac7379e5ea service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:07.849474 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-57f44e9d-7a3f-41a7-a6f5-867504ce5b3a req-9e699fe1-e822-482f-9a6a-f6ac7379e5ea service nova] Creating event network-changed:fd2ef2ce-507a-467b-8b2a-376bcbddebb0 for instance d80a17c8-1887-4a66-8973-36998354c405 on hv-cinder-84175 May 13 14:05:07.855288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-57f44e9d-7a3f-41a7-a6f5-867504ce5b3a req-9e699fe1-e822-482f-9a6a-f6ac7379e5ea service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037429 May 13 14:05:07.855901 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 526/1069] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:07.901852 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:07.902793 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:07.910540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:07.911273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:07.912328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:07.912929 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:08.289551 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:08.290228 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:08.298634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:08.299107 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:08.300099 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:08.300542 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:08.582557 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:08.591921 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-01fece72-781e-4b78-bf1f-e4bce500ba3f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1549 microversion: 2.1 time: 0.693917 May 13 14:05:08.592597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 544/1070] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:07 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1549 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:08.621154 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:08.621861 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:08.622098 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:08.628858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:08.629690 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:08.630472 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-fa9cd09d-c60d-468a-ba24-11c5452f7d93 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.346195 May 13 14:05:08.630613 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:08.631010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:08.631411 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 527/1071] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:08 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:05:08.866331 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:08.873643 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-3d5fa06c-dda4-4335-873d-5157da831725 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1549 microversion: 2.1 time: 0.265671 May 13 14:05:08.874298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 545/1072] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:08 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1549 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:08.890160 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:08.894073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:08.894863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Searching by: {'deleted': False, 'project_id': '673435f01c47460bae84e4f31643f66d'} {{(pid=123511) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 14:05:08.901891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:08.902333 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:08.903173 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:08.903600 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:09.000962 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.multi_cell_list [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=123511) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 14:05:09.097268 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e1f9435b-2a4d-4630-a229-5ed801d75d87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211087 May 13 14:05:09.097767 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 528/1073] 10.222.0.79 () {58 vars in 1124 bytes} [Fri May 13 14:05:08 2022] GET /compute/v2.1/servers => generated 343 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:09.108098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:09.108697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:09.115845 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:09.116292 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:09.117077 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:09.117507 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:09.252884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:09.268529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fa26ab52-2030-4ea4-806e-727aa18e3285 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1549 microversion: 2.1 time: 0.164243 May 13 14:05:09.269108 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 546/1074] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:09 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:09.648151 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:09.648781 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:09.655100 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:09.656323 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:09.657843 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:09.658348 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:09.800550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:09.809114 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9095a251-fe72-490b-8d06-23f2be5977d1 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.164702 May 13 14:05:09.809830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 529/1075] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:09 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:10.808261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:10.809330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:10.815664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:10.816115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:10.816902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:10.817346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:10.826838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:10.828232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:10.834965 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:10.835414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:10.836276 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:10.836688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:10.978881 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:10.992460 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cb8a7d28-0d2c-4fa3-bd21-3dbffc4f5768 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.169456 May 13 14:05:10.993058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 530/1076] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:10 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:05:11.121851 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-eb11c424-3f5e-4a18-bbf9-3a70a548c879 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317453 May 13 14:05:11.122794 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 547/1077] 10.222.0.79 () {60 vars in 1322 bytes} [Fri May 13 14:05:10 2022] POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:12.009519 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:12.010133 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:12.017550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:12.018004 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:12.018816 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:12.019259 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:12.147596 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:12.155315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e6fcbdd9-3518-4ef6-a241-126f6d331d30 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.149766 May 13 14:05:12.155905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 531/1078] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:12 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:13.174045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:13.174773 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:13.181384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:13.181837 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:13.182628 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:13.183104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:13.323646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:13.332221 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-08e78325-59f6-447f-9ce3-7e9e4864efab tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.163151 May 13 14:05:13.332774 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 548/1079] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:13 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:13.928709 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-45f8a525-2570-4c17-b6e3-68864d999a86 req-32c83198-cf5a-4128-9e7f-a8e3f2707c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80a17c8-1887-4a66-8973-36998354c405", "name": "network-vif-plugged", "status": "completed", "tag": "fd2ef2ce-507a-467b-8b2a-376bcbddebb0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:13.937864 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-45f8a525-2570-4c17-b6e3-68864d999a86 req-32c83198-cf5a-4128-9e7f-a8e3f2707c8c service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:13.938359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-45f8a525-2570-4c17-b6e3-68864d999a86 req-32c83198-cf5a-4128-9e7f-a8e3f2707c8c service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:13.953092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-45f8a525-2570-4c17-b6e3-68864d999a86 req-32c83198-cf5a-4128-9e7f-a8e3f2707c8c service nova] Creating event network-vif-plugged:fd2ef2ce-507a-467b-8b2a-376bcbddebb0 for instance d80a17c8-1887-4a66-8973-36998354c405 on hv-cinder-84175 May 13 14:05:13.958180 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-45f8a525-2570-4c17-b6e3-68864d999a86 req-32c83198-cf5a-4128-9e7f-a8e3f2707c8c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 May 13 14:05:13.958841 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 532/1080] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:05:14.355019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:14.356391 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:14.365423 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:14.365883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:14.366951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:14.367623 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:14.529669 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:14.538374 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a887cdfa-c370-4510-af20-fb7ef82c42be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.187852 May 13 14:05:14.539021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 549/1081] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:14 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:15.563983 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:15.565292 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:15.571482 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:15.571943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:15.572731 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:15.573178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:15.709650 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:15.717398 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c4745cee-30a8-4ae5-b70f-f8c9138cdd6a tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.158599 May 13 14:05:15.717986 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 533/1082] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:15 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:16.734127 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:16.735379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:16.742231 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:16.742791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:16.743646 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:16.744093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:16.884229 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:16.892668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-48fde7d5-8a3c-4318-b9c8-bfc0bc4c9615 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.162375 May 13 14:05:16.893265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 550/1083] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:16 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:17.909714 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:17.910419 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:17.917009 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:17.917458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:17.918275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:17.918746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:18.050972 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:18.058225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-b4fff169-05fb-40aa-8194-a18192b5857e tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1315 microversion: 2.1 time: 0.152447 May 13 14:05:18.058811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 534/1084] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:17 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:19.076304 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:19.076920 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:19.084010 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.084470 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.085242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.085684 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.219739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:19.227873 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6c871580-6967-479c-832a-dce1bb8f8fda tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1465 microversion: 2.1 time: 0.156126 May 13 14:05:19.228442 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 551/1085] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:19 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1465 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:19.270014 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:19.270783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:19.278837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.279643 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.280749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.282044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.315594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:05:19.410308 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c3137c6c-03f8-4fd5-901b-9c463cc01cc5 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "DELETE /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 204 len: 0 microversion: 2.1 time: 0.146237 May 13 14:05:19.410828 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 535/1086] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:05:19 2022] DELETE /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:05:19.419340 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:19.420614 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:19.427266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.427715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.428539 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.428923 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.576902 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:19.584536 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-97ef7af8-a837-4d2e-b6b8-d0955e8b4f12 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1471 microversion: 2.1 time: 0.169406 May 13 14:05:19.585437 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 552/1087] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:19 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:19.802601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:19.803344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:19.809347 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.809804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.810603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:19.811079 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:19.982765 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:19.991713 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8e2a5ff7-6c6f-46ce-ae8e-e655ced17100 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1595 microversion: 2.1 time: 0.193368 May 13 14:05:19.992188 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 536/1088] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:19 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1595 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:20.602792 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:20.603519 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:20.610371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:20.610957 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:20.611853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:20.612380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:20.857350 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:20.869068 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7f693f55-ef93-47df-a787-3c7cc9a5199c tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1471 microversion: 2.1 time: 0.270410 May 13 14:05:20.870029 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 553/1089] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:20 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1471 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:21.886020 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:21.886906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:21.893850 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:21.894397 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:21.895292 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:21.895810 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:22.021060 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ea439eafe224df0bd7fb46b6785e09b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed183118dd8c4a84a96cc1cdc92d3a7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:22.029616 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ecb23391-9a82-4fdb-8b53-f89f3cb4a9be tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 200 len: 1429 microversion: 2.1 time: 0.147476 May 13 14:05:22.030382 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 537/1090] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:21 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 1429 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:22.051237 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-808ff07b-e050-43e3-bc0e-6310e3e97342 req-5db9f5db-081f-4249-8cd2-fd44e836e795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d80a17c8-1887-4a66-8973-36998354c405", "name": "network-vif-deleted", "tag": "fd2ef2ce-507a-467b-8b2a-376bcbddebb0"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:22.063393 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-808ff07b-e050-43e3-bc0e-6310e3e97342 req-5db9f5db-081f-4249-8cd2-fd44e836e795 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:22.063913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-808ff07b-e050-43e3-bc0e-6310e3e97342 req-5db9f5db-081f-4249-8cd2-fd44e836e795 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:22.076632 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-808ff07b-e050-43e3-bc0e-6310e3e97342 req-5db9f5db-081f-4249-8cd2-fd44e836e795 service nova] Creating event network-vif-deleted:fd2ef2ce-507a-467b-8b2a-376bcbddebb0 for instance d80a17c8-1887-4a66-8973-36998354c405 on hv-cinder-84175 May 13 14:05:22.082962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-808ff07b-e050-43e3-bc0e-6310e3e97342 req-5db9f5db-081f-4249-8cd2-fd44e836e795 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035858 May 13 14:05:22.084254 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 554/1091] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:23.047934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:23.048558 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] [instance: d80a17c8-1887-4a66-8973-36998354c405] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:23.055403 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:23.056104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:23.056648 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:23.057088 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:23.085707 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] HTTP exception thrown: Instance d80a17c8-1887-4a66-8973-36998354c405 could not be found. May 13 14:05:23.092719 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1576291860", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-323121193", "security_groups": [{"name": "tempest-secgroup-smoke-1743970202"}], "block_device_mapping_v2": [{"uuid": "87d61284-6a8f-45c7-8378-dea720ed7077", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "03a70c19-db79-42a5-9674-8042863a7bc5"}]}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Request method failure captured: May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 HTTP/1.1 May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmWO7BlLSKkUhwzkp1PgWyEB52NcV2PUHLQav47HOJCu_F_hE4CHlvzx3Vfl8FGLhyjnE4kGYdOEl3KvKXp1H9foffQ_Qxwyge_Ghzf-_XTCWaGCLyeRcvCyGxPKo6mH7Blcgiy6zF3dnLwEy3xb8fehQG6TLKL1dU2ky0imQjpm1sU May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: ed183118dd8c4a84a96cc1cdc92d3a7a May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-VolumesNegativeTest-158024154 May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:05:23.102008 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ed183118dd8c4a84a96cc1cdc92d3a7a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/ed183118dd8c4a84a96cc1cdc92d3a7a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/ed183118dd8c4a84a96cc1cdc92d3a7a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_ed183118dd8c4a84a96cc1cdc92d3a7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-VolumesNegativeTest-158024154 May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: ed183118dd8c4a84a96cc1cdc92d3a7a May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-VolumesNegativeTest-158024154 May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-VolumesNegativeTest-158024154-project May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 6ea439eafe224df0bd7fb46b6785e09b May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-VolumesNegativeTest-158024154-project May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance d80a17c8-1887-4a66-8973-36998354c405 could not be found. May 13 14:05:23.103783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'd80a17c8-1887-4a66-8973-36998354c405'} May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d80a17c8-1887-4a66-8973-36998354c405 could not be found. May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:05:23.104756 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d80a17c8-1887-4a66-8973-36998354c405 could not be found. May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d80a17c8-1887-4a66-8973-36998354c405 could not be found. May 13 14:05:23.106306 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:05:23.107933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] Returning 404 to user: Instance d80a17c8-1887-4a66-8973-36998354c405 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:05:23.107933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-48adc86e-71de-4e3d-8efe-78b91c1179c8 tempest-VolumesNegativeTest-158024154 tempest-VolumesNegativeTest-158024154-project] 10.222.0.79 "GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405" status: 404 len: 111 microversion: 2.1 time: 0.060304 May 13 14:05:23.107933 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 538/1092] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:23 2022] GET /compute/v2.1/servers/d80a17c8-1887-4a66-8973-36998354c405 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:05:23.313582 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] validate_networks() for [('03a70c19-db79-42a5-9674-8042863a7bc5', None, None, None, None, None)] {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:05:23.760738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1299175996"}} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:23.761275 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:23.769804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:23.772044 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:23.777835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:23.778279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:24.350791 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.network.security_group_api [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Adding security group b8880a6a-849a-496a-bafa-1672d8af8b35 to port 4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 May 13 14:05:24.414975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:05:24.415677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:05:24.416261 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:05:24.417132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:05:24.417677 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:05:24.428516 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:24.428978 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:24.429850 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:24.430246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:24.460593 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:05:24.467135 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Getting quotas for user a27e83f9f5fb4a0b99e7fac6ab90b3e4 and project fbbf18059349404c9ed7f53c5b38d2fd. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:05:24.552917 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:05:24.555326 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='87d61284-6a8f-45c7-8378-dea720ed7077',volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:05:24.742007 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-4eed5617-2f35-454f-8e29-b845896d4f9e tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.654008 May 13 14:05:24.743752 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 555/1093] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:05:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 14:05:24.749212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-fe2c76a0-5f1b-4252-b184-961d96a4ef49 req-602dea55-a009-4236-8a00-8ca04ec4d6f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:24.759240 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-fe2c76a0-5f1b-4252-b184-961d96a4ef49 req-602dea55-a009-4236-8a00-8ca04ec4d6f8 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:24.760033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-fe2c76a0-5f1b-4252-b184-961d96a4ef49 req-602dea55-a009-4236-8a00-8ca04ec4d6f8 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:24.776712 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-fe2c76a0-5f1b-4252-b184-961d96a4ef49 req-602dea55-a009-4236-8a00-8ca04ec4d6f8 service nova] Creating event network-changed:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:05:24.789030 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-fe2c76a0-5f1b-4252-b184-961d96a4ef49 req-602dea55-a009-4236-8a00-8ca04ec4d6f8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043617 May 13 14:05:24.789860 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 556/1094] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:24.798748 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-de1fc856-af29-4e5c-9f7f-86ca30d4380a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:24.799472 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-de1fc856-af29-4e5c-9f7f-86ca30d4380a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:24.925770 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f9aa6285-4d39-4f19-96a8-b48f82e9d67c tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/action" status: 202 len: 0 microversion: 2.1 time: 1.169517 May 13 14:05:24.927019 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 539/1095] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:05:23 2022] POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/action => generated 0 bytes in 1171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 14:05:24.935451 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-de1fc856-af29-4e5c-9f7f-86ca30d4380a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:24.944070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:24.946320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:24.953385 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-de1fc856-af29-4e5c-9f7f-86ca30d4380a tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1094 microversion: 2.1 time: 0.162209 May 13 14:05:24.957790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 557/1096] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:24 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1094 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:24.965677 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:24.967267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:24.968118 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:24.969089 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:25.401701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:25.409834 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-21298443-967e-4bee-8155-a129237f6b9d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1642 microversion: 2.1 time: 0.474625 May 13 14:05:25.410423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 540/1097] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:24 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1642 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:25.973149 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:25.973787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:25.981346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:25.981800 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:25.982673 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:25.983128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:26.069889 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:26.079102 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ef2454df-78b3-43b9-8c3e-97bbe4b6b553 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1192 microversion: 2.1 time: 0.110395 May 13 14:05:26.079838 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 558/1098] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:25 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1192 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:26.808738 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-9a141934-ca68-4b37-b636-de74a994f865 req-ad63d1da-8419-4f5d-86aa-e60ab53c8a19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:26.818364 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9a141934-ca68-4b37-b636-de74a994f865 req-ad63d1da-8419-4f5d-86aa-e60ab53c8a19 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:26.819928 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9a141934-ca68-4b37-b636-de74a994f865 req-ad63d1da-8419-4f5d-86aa-e60ab53c8a19 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:26.835809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-9a141934-ca68-4b37-b636-de74a994f865 req-ad63d1da-8419-4f5d-86aa-e60ab53c8a19 service nova] Creating event network-changed:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:05:26.842087 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-9a141934-ca68-4b37-b636-de74a994f865 req-ad63d1da-8419-4f5d-86aa-e60ab53c8a19 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037171 May 13 14:05:26.844049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 541/1099] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:27.111409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:27.114072 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:27.137526 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:27.139533 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:27.141951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:27.142791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:27.475956 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:27.495909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-c0e67e2f-fd55-41aa-bce4-c48eccf5dc31 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1278 microversion: 2.1 time: 0.402874 May 13 14:05:27.497540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 559/1100] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:27 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1278 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:28.516668 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:28.518052 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:28.525523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:28.526244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:28.527244 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:28.527686 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:28.716966 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:28.725972 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d4574fd0-e4c7-41e7-899e-23675bb6c49d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.215434 May 13 14:05:28.726629 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 542/1101] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:28 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:28.861909 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-0593d5fd-6fab-455c-9a03-e6204fe0926b req-fbf2c59a-4574-4313-b457-9fb83c3d1e67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ac6b7a-a490-4480-856f-bb49226bf74b", "tag": "56451a8d-3048-44a7-b7ab-e2d415fa3160"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:28.871972 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-0593d5fd-6fab-455c-9a03-e6204fe0926b req-fbf2c59a-4574-4313-b457-9fb83c3d1e67 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:28.872425 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-0593d5fd-6fab-455c-9a03-e6204fe0926b req-fbf2c59a-4574-4313-b457-9fb83c3d1e67 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:28.888695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-0593d5fd-6fab-455c-9a03-e6204fe0926b req-fbf2c59a-4574-4313-b457-9fb83c3d1e67 service nova] Creating event network-changed:56451a8d-3048-44a7-b7ab-e2d415fa3160 for instance e0ac6b7a-a490-4480-856f-bb49226bf74b on hv-cinder-84175 May 13 14:05:28.894865 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-0593d5fd-6fab-455c-9a03-e6204fe0926b req-fbf2c59a-4574-4313-b457-9fb83c3d1e67 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037374 May 13 14:05:28.895930 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 560/1102] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:29.743767 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:29.745003 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:29.752930 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:29.753610 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:29.754464 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:29.755170 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:29.981597 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:29.989530 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-29494012-5630-45d7-9569-0a3d96d1f5ec tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.249518 May 13 14:05:29.990120 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 543/1103] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:29 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:31.006313 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:31.007728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:31.014910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:31.015910 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:31.016995 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:31.017501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:31.187952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:31.195483 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5281ec7e-4991-4ddb-ad3b-0e3041adbbfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.193434 May 13 14:05:31.196056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 561/1104] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:31 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:32.212848 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:32.213531 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:32.223254 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:32.224128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:32.225116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:32.225564 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:32.389390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:32.398375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c68099b0-df95-46a0-88e4-e10bcd340619 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.189729 May 13 14:05:32.399319 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 544/1105] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:32 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:33.417018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:33.420368 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:33.428666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:33.429256 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:33.430787 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:33.431391 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:33.626959 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:33.650215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ea006e8e-ed63-4320-84c6-1fb3f9b94104 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.236869 May 13 14:05:33.654966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 562/1106] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:33 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:34.675688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:34.677503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:34.688582 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:34.689487 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:34.690429 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:34.691136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:34.898934 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:34.907208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-26f6d603-7d9d-4899-b673-2694422a3262 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.238240 May 13 14:05:34.907798 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 545/1107] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:34 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:35.926465 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:35.927177 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:35.935159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:35.935796 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:35.937246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:35.938018 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:36.148801 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:36.161682 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-46d3effc-ded6-4cb9-8e9f-8ee20c110d01 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.240180 May 13 14:05:36.163161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 563/1108] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:35 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:37.189890 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:37.192049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:37.205226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:37.206167 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:37.207589 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:37.208320 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:37.518362 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:37.537577 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-170d6362-bfa6-47b5-9453-febd9770781b tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.357535 May 13 14:05:37.539820 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 546/1109] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:37 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:38.556576 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:38.557212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:38.567056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:38.567505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:38.584603 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:38.585219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:38.853439 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:38.866330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ddf97841-839c-4146-ab24-da3e9e6297be tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.314077 May 13 14:05:38.867404 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 564/1110] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:38 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:39.885030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:39.886331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:39.893739 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:39.894185 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:39.895240 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:39.895675 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:40.095615 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:40.104201 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-dfa9b0c8-5d42-44de-833c-c00cd7b52817 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.223117 May 13 14:05:40.104793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 547/1111] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:39 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:40.262394 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-0a09b80b-6703-494e-9bba-44ae89885755 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Action: 'create', calling method: .version_select at 0x7fb3bdbbea60>, body: {"keypair": {"name": "tempest-TestShelveInstance-1976190613", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKfDcsajv4mr7O6qqkyO4ye2eHDor6+x0WdoS1Z8n5LXApEWBtMyuQ/X0qnmxlJRBqigzTZZVRFe3rXSlVyb831qLkG+hd3aQNFMW/Y50gx7zKu7TReGHam7mM7s7Yk5w=="}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:40.278144 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-0a09b80b-6703-494e-9bba-44ae89885755 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Getting quotas for project 54b153696d2b445098e70dce631b13b6. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:05:40.282122 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-0a09b80b-6703-494e-9bba-44ae89885755 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Getting quotas for user 4ac7988aa0e74fc6b56269d975270d48 and project 54b153696d2b445098e70dce631b13b6. Resources: {'key_pairs'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:05:40.307471 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-0a09b80b-6703-494e-9bba-44ae89885755 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.242002 May 13 14:05:40.308265 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 565/1112] 10.222.0.79 () {60 vars in 1158 bytes} [Fri May 13 14:05:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:40.567819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-49bb5a70-9c8f-4063-9e96-c21a05c9a0b8 req-71e8b3f6-b2f1-4f53-a064-3d45ea836eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ac6b7a-a490-4480-856f-bb49226bf74b", "name": "network-vif-plugged", "status": "completed", "tag": "56451a8d-3048-44a7-b7ab-e2d415fa3160"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:40.578046 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-49bb5a70-9c8f-4063-9e96-c21a05c9a0b8 req-71e8b3f6-b2f1-4f53-a064-3d45ea836eb7 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:40.578505 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-49bb5a70-9c8f-4063-9e96-c21a05c9a0b8 req-71e8b3f6-b2f1-4f53-a064-3d45ea836eb7 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:40.591996 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-49bb5a70-9c8f-4063-9e96-c21a05c9a0b8 req-71e8b3f6-b2f1-4f53-a064-3d45ea836eb7 service nova] Creating event network-vif-plugged:56451a8d-3048-44a7-b7ab-e2d415fa3160 for instance e0ac6b7a-a490-4480-856f-bb49226bf74b on hv-cinder-84175 May 13 14:05:40.601027 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-49bb5a70-9c8f-4063-9e96-c21a05c9a0b8 req-71e8b3f6-b2f1-4f53-a064-3d45ea836eb7 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037038 May 13 14:05:40.603764 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 548/1113] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:41.129743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:41.130365 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:41.137777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:41.138216 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:41.139065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:41.139503 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:41.331511 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:41.339361 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d1cafeac-48fc-47ff-b491-e39c52198884 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1266 microversion: 2.1 time: 0.218544 May 13 14:05:41.342246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 566/1114] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:41 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1266 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:42.358588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:42.360352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:42.373281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:42.373281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:42.373281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:42.373281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:42.512318 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:42.520054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0246d385-0b12-48e7-b088-75f217734804 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1452 microversion: 2.1 time: 0.166793 May 13 14:05:42.520627 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 549/1115] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:42 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:42.536652 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:42.537268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:42.543988 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:42.544531 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:42.545253 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:42.545633 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:42.718870 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:42.730182 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-687a0919-c233-42a3-9b11-6d62aea93bfb tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1452 microversion: 2.1 time: 0.197149 May 13 14:05:42.731290 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 567/1116] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:42 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1452 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:45.171892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-bf0e0eaf-220d-4b07-99d3-20feba59e721 req-7b45efea-8a57-4a50-b0a4-88ad8d29458e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ac6b7a-a490-4480-856f-bb49226bf74b", "tag": "56451a8d-3048-44a7-b7ab-e2d415fa3160"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:45.182225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-bf0e0eaf-220d-4b07-99d3-20feba59e721 req-7b45efea-8a57-4a50-b0a4-88ad8d29458e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:45.182830 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-bf0e0eaf-220d-4b07-99d3-20feba59e721 req-7b45efea-8a57-4a50-b0a4-88ad8d29458e service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:45.196514 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-bf0e0eaf-220d-4b07-99d3-20feba59e721 req-7b45efea-8a57-4a50-b0a4-88ad8d29458e service nova] Creating event network-changed:56451a8d-3048-44a7-b7ab-e2d415fa3160 for instance e0ac6b7a-a490-4480-856f-bb49226bf74b on hv-cinder-84175 May 13 14:05:45.201937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-bf0e0eaf-220d-4b07-99d3-20feba59e721 req-7b45efea-8a57-4a50-b0a4-88ad8d29458e service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033824 May 13 14:05:45.202665 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 550/1117] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:05:54.604978 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:05:54.606033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:54.613132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:54.613581 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:54.614406 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:54.614889 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:54.711340 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-91d788a3-4089-4b49-8091-8379fe13cfcd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/action" status: 202 len: 0 microversion: 2.1 time: 0.104388 May 13 14:05:54.711340 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 568/1118] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:05:54 2022] POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:05:54.716519 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:54.717413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:54.724836 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:54.725291 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:54.726130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:54.726570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:55.072438 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:55.088861 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a8a7184a-5a35-4996-992a-b426b6b237b6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1752 microversion: 2.1 time: 0.377382 May 13 14:05:55.089480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 551/1119] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:54 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1752 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:56.106874 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:56.107578 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:56.119983 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:56.121065 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:56.122829 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:56.123912 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:56.356383 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:56.365384 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-66b00192-f06d-4a57-ba13-43addb940fc6 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.263523 May 13 14:05:56.365962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 569/1120] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:56 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:57.383084 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:57.383699 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:57.390973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:57.391424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:57.392206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:57.392646 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:57.543835 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:57.552209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-089448fe-bea8-486e-8d6f-bb114c7e016d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.172892 May 13 14:05:57.552795 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 552/1121] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:57 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:58.569484 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:58.570128 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:58.576804 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:58.577257 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:58.578048 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:58.578494 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:58.742497 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:58.750520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-cf5f45b2-e2a8-44ee-8946-761dfced1624 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.184877 May 13 14:05:58.751134 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 570/1122] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:58 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:05:59.768370 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:05:59.769178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:05:59.775804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:59.776176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:59.776971 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:05:59.777467 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:05:59.945555 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:05:59.954388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e8d14442-dc52-4686-9150-619cb45849ad tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.190406 May 13 14:05:59.955018 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 553/1123] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:05:59 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:00.970506 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:00.971396 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:00.978780 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:00.979142 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:00.979938 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:00.980401 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:01.151982 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:01.160309 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ba27cc43-1f2f-46f7-b8c4-1794833b5027 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.193729 May 13 14:06:01.160863 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 571/1124] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:00 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:02.177475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:02.178094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:02.184544 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:02.185005 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:02.185783 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:02.186221 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:02.331879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:02.339663 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d8b0a1d3-8ff3-4054-bd74-78f93b21d7f8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.166013 May 13 14:06:02.340225 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 554/1125] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:02 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:03.266989 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1672091050", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1976190613", "security_groups": [{"name": "tempest-secgroup-smoke-267415705"}], "networks": [{"uuid": "43ba0f5f-8320-4bb0-9dbd-89fafd262362"}], "block_device_mapping_v2": [{"uuid": "f52bac9e-100a-4818-8fff-7f1ffef7b97a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:03.355740 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:03.356392 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:03.369178 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:03.369623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:03.370414 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:03.370887 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:03.388215 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.network.neutron [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] validate_networks() for [('43ba0f5f-8320-4bb0-9dbd-89fafd262362', None, None, None, None, None)] {{(pid=123512) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 14:06:03.601917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:03.612094 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-9ed1efd9-6f72-4e52-b618-e05b5b2cde5e tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.260151 May 13 14:06:03.612699 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 555/1126] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:03 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:06:03.835587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Flavor limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 14:06:03.836019 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Image limits 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 14:06:03.836525 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Flavor pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 14:06:03.836934 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Image pref 0:0:0 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 14:06:03.837339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.virt.hardware [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=123512) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 14:06:03.846634 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:03.847115 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:03.847913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:03.848349 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:03.865273 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Getting quotas for project 54b153696d2b445098e70dce631b13b6. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 14:06:03.869310 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.quota [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Getting quotas for user 4ac7988aa0e74fc6b56269d975270d48 and project 54b153696d2b445098e70dce631b13b6. Resources: {'ram', 'cores', 'instances'} {{(pid=123512) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 14:06:03.928704 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Going to run 1 instances... {{(pid=123512) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 14:06:03.930862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f52bac9e-100a-4818-8fff-7f1ffef7b97a',volume_size=None,volume_type=None)] {{(pid=123512) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 14:06:04.068847 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-190c00fc-f6ce-4136-8c1d-be65d06188b1 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.805594 May 13 14:06:04.069519 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 572/1127] 10.222.0.79 () {60 vars in 1146 bytes} [Fri May 13 14:06:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 14:06:04.080213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2605e937-2800-4653-81e9-e0a3daea7ef3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:04.080832 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2605e937-2800-4653-81e9-e0a3daea7ef3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:04.136086 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2605e937-2800-4653-81e9-e0a3daea7ef3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:04.143266 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2605e937-2800-4653-81e9-e0a3daea7ef3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1089 microversion: 2.1 time: 0.067582 May 13 14:06:04.143845 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 556/1128] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:04 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1089 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:04.629777 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:04.630371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:04.637419 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:04.637866 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:04.639355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:04.639715 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:04.868971 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:04.877611 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-5bf9bab2-c405-4081-b59f-ace068d80e4f tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.251906 May 13 14:06:04.878210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 573/1129] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:04 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:04.977129 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:06:04.977696 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:06:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:06:05.161634 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:05.162743 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:05.170436 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:05.171349 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:05.172191 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:05.173097 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:05.292566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:05.305628 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-64eae7bd-3226-4e7c-8414-0543ff080446 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1195 microversion: 2.1 time: 0.147886 May 13 14:06:05.316916 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 557/1130] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:05 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1195 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:05.896822 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:05.897649 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:05.905139 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:05.905595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:05.907120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:05.907707 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:06.167520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:06.177665 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-adeeec23-e0b7-48ca-9477-482047266649 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.284977 May 13 14:06:06.178258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 574/1131] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:05 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:06.328958 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:06.329794 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:06.338048 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:06.338502 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:06.339315 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:06.339749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:06.563442 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:06.570840 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-70fcda39-1f29-4d58-8a6b-9bc2e749f186 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.245899 May 13 14:06:06.571423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 558/1132] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:06 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:07.204881 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:07.205462 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:07.207771 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-bd0f8194-e983-483b-ad40-7054db26fd16 req-bf1260e6-ef84-4644-8704-e98386e4cabd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:07.222274 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-bd0f8194-e983-483b-ad40-7054db26fd16 req-bf1260e6-ef84-4644-8704-e98386e4cabd service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.225538 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.225984 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.226781 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.227242 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.230281 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-bd0f8194-e983-483b-ad40-7054db26fd16 req-bf1260e6-ef84-4644-8704-e98386e4cabd service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.244987 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-bd0f8194-e983-483b-ad40-7054db26fd16 req-bf1260e6-ef84-4644-8704-e98386e4cabd service nova] Creating event network-changed:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:06:07.252056 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-bd0f8194-e983-483b-ad40-7054db26fd16 req-bf1260e6-ef84-4644-8704-e98386e4cabd service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059473 May 13 14:06:07.253331 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 559/1133] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:07.459420 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:07.468399 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-337e1bdd-d052-42de-8280-59bce96de4b1 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.271088 May 13 14:06:07.469556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 575/1134] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:07 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:07.588516 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:07.589208 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:07.596066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.596512 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.597290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:07.597716 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:07.812323 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:07.820387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-5bc4cca2-f6c9-467e-b72c-d093d739b3ad tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.236480 May 13 14:06:07.820997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 560/1135] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:07 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:08.486176 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:08.486826 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:08.493547 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.493992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.494809 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.495246 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.714218 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:08.722545 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-611f2a99-9815-4b5e-a4b6-640627765aa8 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.240894 May 13 14:06:08.723161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 576/1136] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:08 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:08.837396 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:08.838077 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:08.845158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.845608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.846387 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:08.846855 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:08.988791 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:08.996422 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cb1f4b5f-6061-4e50-bceb-bc49d9387d6c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.162817 May 13 14:06:08.996920 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 561/1137] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:08 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:09.740743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:09.741347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:09.747805 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:09.748258 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:09.749040 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:09.749490 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:09.893805 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:09.901877 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1cbbe85f-15d1-4d5b-a02e-cd90cf983357 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.164963 May 13 14:06:09.902540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 577/1138] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:09 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:10.013763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:10.014379 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:10.021143 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.021596 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.022373 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.022860 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.155768 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:10.163949 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6e0c6977-e1df-447c-ac86-787b1fbe8d1c tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.154565 May 13 14:06:10.164523 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 562/1139] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:10 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:10.920217 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:10.921073 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:10.928588 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.929096 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:10.930036 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:10.930520 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:11.076151 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:11.084528 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d0a1ed56-a65e-46ce-be0b-574572a497b7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1757 microversion: 2.1 time: 0.168479 May 13 14:06:11.085091 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 578/1140] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:10 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:11.181453 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:11.181982 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:11.189130 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:11.189570 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:11.190330 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:11.190793 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:11.328955 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:11.336636 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-32a43d3c-19bc-412b-a3ae-2a1a341b949a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.159231 May 13 14:06:11.337214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 563/1141] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:11 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:12.101315 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:12.101925 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:12.108705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.109147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.110513 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.110982 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.265098 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:12.275472 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1aecaea5-5212-4a12-a074-24a4ba72a40d tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1760 microversion: 2.1 time: 0.177913 May 13 14:06:12.276090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 579/1142] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:12 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:12.353391 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:12.354010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:12.361107 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.361563 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.362344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:12.362822 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:12.493767 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:12.501852 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-a35b2750-2db6-457c-9ca3-45352d39c324 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.152316 May 13 14:06:12.502424 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 564/1143] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:12 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:13.517505 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:13.518097 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:13.524529 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:13.524976 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:13.525745 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:13.526191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:13.661230 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:13.668708 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-a5421e0c-f33e-4c2c-8ca8-72d39d3b925f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.155134 May 13 14:06:13.669275 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 580/1144] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:13 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:14.686257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:14.686904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:14.694736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:14.694736 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:14.696104 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:14.696550 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:14.832774 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:14.840752 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-04f3546d-5228-47fd-8ac8-3289381626f3 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.158238 May 13 14:06:14.841253 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 565/1145] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:14 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:15.857962 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:15.858533 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:15.864853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:15.865296 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:15.866064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:15.866500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:16.009430 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:16.017032 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-316a50cd-6d29-4ead-ad90-90ea359dd6a7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.162949 May 13 14:06:16.017602 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 581/1146] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:15 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:17.033475 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:17.034075 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:17.040434 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:17.040879 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:17.041653 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:17.042090 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:17.176474 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:17.184176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e1d5b731-8f19-4cfa-a674-90cc2336b4e0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.154546 May 13 14:06:17.184749 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 566/1147] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:17 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:18.200761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:18.202176 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:18.209043 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:18.209487 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:18.210262 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:18.210695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:18.350055 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:18.363394 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2612e09c-63b2-4df0-b4c9-8d48a840afa7 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.165935 May 13 14:06:18.364720 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 582/1148] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:18 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:18.539342 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-65d7e057-24ac-4312-bb06-15235525b2c5 req-4dfd25b1-86d4-430a-a504-897b1e084548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "name": "network-vif-plugged", "status": "completed", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:18.548853 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-65d7e057-24ac-4312-bb06-15235525b2c5 req-4dfd25b1-86d4-430a-a504-897b1e084548 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:18.549136 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-65d7e057-24ac-4312-bb06-15235525b2c5 req-4dfd25b1-86d4-430a-a504-897b1e084548 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:18.567503 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-65d7e057-24ac-4312-bb06-15235525b2c5 req-4dfd25b1-86d4-430a-a504-897b1e084548 service nova] Creating event network-vif-plugged:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:06:18.572802 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-65d7e057-24ac-4312-bb06-15235525b2c5 req-4dfd25b1-86d4-430a-a504-897b1e084548 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037134 May 13 14:06:18.573397 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 567/1149] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:19.387685 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:19.388298 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:19.394754 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:19.395219 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:19.395993 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:19.396435 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:19.534587 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:19.542217 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-9e4e5fae-5c79-49fe-bd06-b2a35ce490a0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1260 microversion: 2.1 time: 0.158397 May 13 14:06:19.542814 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 583/1150] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:19 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:20.561026 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:20.561735 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:20.568371 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:20.568831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:20.569621 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:20.570065 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:20.701992 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:20.710024 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-17f72b40-3190-40ff-a7c4-370ba617d863 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1443 microversion: 2.1 time: 0.153884 May 13 14:06:20.710594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 568/1151] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:20 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:06:20.726284 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:20.726932 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:20.733325 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:20.733769 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:20.734540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:20.735007 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:20.868097 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:20.876252 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-85fed64e-2c28-417e-a1ac-9bcfed655f82 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1443 microversion: 2.1 time: 0.153731 May 13 14:06:20.876820 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 584/1152] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:20 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1443 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:22.918981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-9c2f561f-2a8d-4691-964c-4fd5f89c80a1 req-854f9b3f-d58a-49df-a16d-b494c228eaa3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:22.928809 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9c2f561f-2a8d-4691-964c-4fd5f89c80a1 req-854f9b3f-d58a-49df-a16d-b494c228eaa3 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:22.929253 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-9c2f561f-2a8d-4691-964c-4fd5f89c80a1 req-854f9b3f-d58a-49df-a16d-b494c228eaa3 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:22.946375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-9c2f561f-2a8d-4691-964c-4fd5f89c80a1 req-854f9b3f-d58a-49df-a16d-b494c228eaa3 service nova] Creating event network-changed:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:06:22.952423 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-9c2f561f-2a8d-4691-964c-4fd5f89c80a1 req-854f9b3f-d58a-49df-a16d-b494c228eaa3 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037346 May 13 14:06:22.953054 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 569/1153] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:06:50.936276 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1299175996"}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:50.936864 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:50.943564 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:50.944023 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:50.944791 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:50.945227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:51.079411 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.network.security_group_api [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Removing security group b8880a6a-849a-496a-bafa-1672d8af8b35 from port 4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 May 13 14:06:51.422660 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-868e1e8e-ca15-47f8-b188-21896ac91532 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/action" status: 202 len: 0 microversion: 2.1 time: 0.490417 May 13 14:06:51.435144 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-2b65e6d9-9dc7-4b22-92bf-ffb37d565ce4 req-2ee5aa8b-5066-48ed-b0e6-19dba64867b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:51.440279 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 585/1154] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:06:50 2022] POST /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:06:51.445760 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-2b65e6d9-9dc7-4b22-92bf-ffb37d565ce4 req-2ee5aa8b-5066-48ed-b0e6-19dba64867b1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:51.446510 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-2b65e6d9-9dc7-4b22-92bf-ffb37d565ce4 req-2ee5aa8b-5066-48ed-b0e6-19dba64867b1 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:51.472906 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-2b65e6d9-9dc7-4b22-92bf-ffb37d565ce4 req-2ee5aa8b-5066-48ed-b0e6-19dba64867b1 service nova] Creating event network-changed:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:06:51.480652 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-2b65e6d9-9dc7-4b22-92bf-ffb37d565ce4 req-2ee5aa8b-5066-48ed-b0e6-19dba64867b1 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049913 May 13 14:06:51.481640 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 570/1155] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:06:52.575045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:52.575045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:52.582450 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:52.582953 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:52.583753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:52.584375 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:52.675595 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lazy-loading 'services' on Instance uuid fe40eef9-fa2e-466f-ae62-45723cef3733 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:06:52.759010 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-8ea8c25d-b371-4a34-8639-4497fe1582ae req-8e97649f-1792-4b39-a3ce-1f8b2bd185c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:52.763281 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-93223eb5-ccfb-4141-96b7-42006ac878d7 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments/8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7" status: 202 len: 0 microversion: 2.1 time: 0.200301 May 13 14:06:52.764604 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 586/1156] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:06:52 2022] DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments/8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:06:52.767786 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-8ea8c25d-b371-4a34-8639-4497fe1582ae req-8e97649f-1792-4b39-a3ce-1f8b2bd185c8 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:52.768354 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-8ea8c25d-b371-4a34-8639-4497fe1582ae req-8e97649f-1792-4b39-a3ce-1f8b2bd185c8 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:52.774160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:52.775278 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:52.780116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-8ea8c25d-b371-4a34-8639-4497fe1582ae req-8e97649f-1792-4b39-a3ce-1f8b2bd185c8 service nova] Creating event network-changed:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:06:52.783152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:52.783638 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:52.784493 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:52.784989 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:52.786821 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-8ea8c25d-b371-4a34-8639-4497fe1582ae req-8e97649f-1792-4b39-a3ce-1f8b2bd185c8 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.218535 May 13 14:06:52.790133 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 571/1157] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:52.818952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bb845ddc-554f-480e-b38b-32424d8fda87 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049605 May 13 14:06:52.819838 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 587/1158] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:06:52 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:53.837030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:53.838092 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:53.846810 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:53.847267 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:53.848073 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:53.848520 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:53.886826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-48ae173c-bef5-49be-aa74-55f4988383ed tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059152 May 13 14:06:53.887416 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 572/1159] 10.222.0.79 () {58 vars in 1301 bytes} [Fri May 13 14:06:53 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 14:06:53.898394 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:53.899056 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:53.905885 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:53.906411 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:53.907753 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:53.908211 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:54.003093 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] HTTP exception thrown: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 is not attached to volume 8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Request method failure captured: May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments/8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 HTTP/1.1 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmVo2BpLMBZ5VGe_mQyyCQCMI3kBcx36PO9NRSBNP_fwz4dyvWrPvkjv1sT4oqE2iLc4e1StYor2udlSF0fPji6vjMMgB_ijwMEnoiVfuPXBmhAHtkZ9JHNG2zSoVnTgNIgym6zKEtdpe3R7yR5UFUuP2HFdR673yuMvyoSYR0a_hg8 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 673435f01c47460bae84e4f31643f66d May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-TestMinimumBasicScenario-1216032295 May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:06:54.005705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/673435f01c47460bae84e4f31643f66d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/673435f01c47460bae84e4f31643f66d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/673435f01c47460bae84e4f31643f66d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_673435f01c47460bae84e4f31643f66d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-TestMinimumBasicScenario-1216032295 May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 673435f01c47460bae84e4f31643f66d May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1216032295 May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-TestMinimumBasicScenario-1216032295-project May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 3bbfb51ebb5f4553a9ef7b70becf1a9a May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-TestMinimumBasicScenario-1216032295-project May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:06:54.009009 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 is not attached to volume 8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'server_id': 'fe40eef9-fa2e-466f-ae62-45723cef3733', 'id': '8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7'} May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7. May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:06:54.010761 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 is not attached to volume 8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 is not attached to volume 8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:54.014159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Returning 404 to user: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 is not attached to volume 8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:06:54.016705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-bba63204-263e-4246-b48a-8036094b5cbd tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments/8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7" status: 404 len: 154 microversion: 2.1 time: 0.112885 May 13 14:06:54.016705 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 588/1160] 10.222.0.79 () {58 vars in 1415 bytes} [Fri May 13 14:06:53 2022] DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733/os-volume_attachments/8ac1c80c-ec09-4ed2-87d1-f9fa3b3bbdd7 => generated 154 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:06:55.161443 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:55.162680 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:55.169981 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:55.170673 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:55.171437 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:55.171871 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:55.212166 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:06:55.332585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c9458149-00a7-41c5-92e5-e3c71b13a6d5 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 204 len: 0 microversion: 2.1 time: 0.179576 May 13 14:06:55.333050 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 573/1161] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:06:55 2022] DELETE /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:06:55.343853 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:55.344454 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:55.352734 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:55.353336 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:55.354269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:55.354901 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:55.516264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:55.527159 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-50d7a927-5a13-454f-b412-e7e3a13a15cb tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1555 microversion: 2.1 time: 0.188549 May 13 14:06:55.528147 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 589/1162] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:55 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1555 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:56.551200 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:56.551935 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:56.558506 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:56.558979 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:56.559883 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:56.560325 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:56.714957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:56.723394 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-1e8d221c-1d34-4cc1-9f75-489a869e8321 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1555 microversion: 2.1 time: 0.177172 May 13 14:06:56.723997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 574/1163] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:56 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:57.741330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:57.742067 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:57.751735 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:57.752542 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:57.753882 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:57.754612 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:57.981469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bbfb51ebb5f4553a9ef7b70becf1a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '673435f01c47460bae84e4f31643f66d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:06:57.991519 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6c1d410f-4fc7-4ab0-b4dd-fca4969fb903 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 200 len: 1555 microversion: 2.1 time: 0.254148 May 13 14:06:57.992101 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 590/1164] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:57 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 1555 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:06:58.277904 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-818d23ba-7864-44d5-a3ad-1d8102681eef req-9bd6b81a-10c4-4899-9ef2-723ab375d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe40eef9-fa2e-466f-ae62-45723cef3733", "name": "network-vif-deleted", "tag": "4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:06:58.287632 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-818d23ba-7864-44d5-a3ad-1d8102681eef req-9bd6b81a-10c4-4899-9ef2-723ab375d0c5 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:58.288097 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-818d23ba-7864-44d5-a3ad-1d8102681eef req-9bd6b81a-10c4-4899-9ef2-723ab375d0c5 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:58.300577 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-818d23ba-7864-44d5-a3ad-1d8102681eef req-9bd6b81a-10c4-4899-9ef2-723ab375d0c5 service nova] Creating event network-vif-deleted:4cd5dbfc-16b4-4cbd-8a5e-7ba15ec125a8 for instance fe40eef9-fa2e-466f-ae62-45723cef3733 on hv-cinder-84175 May 13 14:06:58.305842 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-818d23ba-7864-44d5-a3ad-1d8102681eef req-9bd6b81a-10c4-4899-9ef2-723ab375d0c5 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111962 May 13 14:06:58.306458 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 575/1165] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:06:59.013522 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:59.014105 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] [instance: fe40eef9-fa2e-466f-ae62-45723cef3733] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:06:59.021631 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:59.022090 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:59.022934 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:06:59.023378 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:06:59.039391 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] HTTP exception thrown: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 could not be found. May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Request method failure captured: May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 HTTP/1.1 May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmVo2BpLMBZ5VGe_mQyyCQCMI3kBcx36PO9NRSBNP_fwz4dyvWrPvkjv1sT4oqE2iLc4e1StYor2udlSF0fPji6vjMMgB_ijwMEnoiVfuPXBmhAHtkZ9JHNG2zSoVnTgNIgym6zKEtdpe3R7yR5UFUuP2HFdR673yuMvyoSYR0a_hg8 May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: 673435f01c47460bae84e4f31643f66d May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-TestMinimumBasicScenario-1216032295 May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:06:59.041294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/673435f01c47460bae84e4f31643f66d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/673435f01c47460bae84e4f31643f66d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/673435f01c47460bae84e4f31643f66d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_673435f01c47460bae84e4f31643f66d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-TestMinimumBasicScenario-1216032295 May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: 673435f01c47460bae84e4f31643f66d May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1216032295 May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-TestMinimumBasicScenario-1216032295-project May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: 3bbfb51ebb5f4553a9ef7b70becf1a9a May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-TestMinimumBasicScenario-1216032295-project May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 could not be found. May 13 14:06:59.043171 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'fe40eef9-fa2e-466f-ae62-45723cef3733'} May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 could not be found. May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:06:59.044123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 could not be found. May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 could not be found. May 13 14:06:59.045695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:06:59.047305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Returning 404 to user: Instance fe40eef9-fa2e-466f-ae62-45723cef3733 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:06:59.047305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-72757d26-0cbd-4ffc-9a11-56e256612938 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733" status: 404 len: 111 microversion: 2.1 time: 0.033786 May 13 14:06:59.047305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 591/1166] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:06:59 2022] GET /compute/v2.1/servers/fe40eef9-fa2e-466f-ae62-45723cef3733 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:06:59.054899 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-770c7584-e55d-4ab4-a1ec-541d780d8b55 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] Calling method '.version_select at 0x7fb3be81e430>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:06:59.082409 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-770c7584-e55d-4ab4-a1ec-541d780d8b55 tempest-TestMinimumBasicScenario-1216032295 tempest-TestMinimumBasicScenario-1216032295-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-505401172" status: 202 len: 0 microversion: 2.1 time: 0.031749 May 13 14:06:59.083067 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 576/1167] 10.222.0.79 () {58 vars in 1268 bytes} [Fri May 13 14:06:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-505401172 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:07:25.605957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-def3f82a-3d98-4220-89c0-f01450683e57 req-91723a8e-3d32-45cd-805d-663f3d3bff66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0ac6b7a-a490-4480-856f-bb49226bf74b", "tag": "56451a8d-3048-44a7-b7ab-e2d415fa3160"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:25.606644 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:25.607196 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:25.613676 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:25.614231 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:25.614690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-def3f82a-3d98-4220-89c0-f01450683e57 req-91723a8e-3d32-45cd-805d-663f3d3bff66 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:25.615180 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:25.615289 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-def3f82a-3d98-4220-89c0-f01450683e57 req-91723a8e-3d32-45cd-805d-663f3d3bff66 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:25.615707 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:25.626815 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-def3f82a-3d98-4220-89c0-f01450683e57 req-91723a8e-3d32-45cd-805d-663f3d3bff66 service nova] Creating event network-changed:56451a8d-3048-44a7-b7ab-e2d415fa3160 for instance e0ac6b7a-a490-4480-856f-bb49226bf74b on hv-cinder-84175 May 13 14:07:25.633158 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-def3f82a-3d98-4220-89c0-f01450683e57 req-91723a8e-3d32-45cd-805d-663f3d3bff66 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031112 May 13 14:07:25.634003 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 577/1168] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:25.643736 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:07:25.729928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6ac101c3-581f-47e9-8dc3-1ed20dfb5059 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "DELETE /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 204 len: 0 microversion: 2.1 time: 0.129382 May 13 14:07:25.730668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 592/1169] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:07:25 2022] DELETE /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:07:25.740778 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:25.741491 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:25.747751 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:25.748213 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:25.749004 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:25.749461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:25.913967 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:25.921465 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d8c7a5d0-1aef-4048-b3ae-6ae18bcefd10 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1575 microversion: 2.1 time: 0.185372 May 13 14:07:25.922116 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 578/1170] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:25 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:26.940123 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:26.940828 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:26.947469 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:26.947924 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:26.948701 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:26.949141 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:27.092997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:27.101033 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-206b78b5-d30c-4ee6-8790-4c51f1737902 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1575 microversion: 2.1 time: 0.165229 May 13 14:07:27.101597 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 593/1171] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:26 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:28.117433 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:28.118033 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:28.124257 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:28.124700 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:28.125465 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:28.125893 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:28.319641 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-364b56ec-db34-465f-988a-8633109b8c4c req-a8f2415b-6a52-4e16-b428-b8087b1164c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0ac6b7a-a490-4480-856f-bb49226bf74b", "name": "network-vif-deleted", "tag": "56451a8d-3048-44a7-b7ab-e2d415fa3160"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:28.329898 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-364b56ec-db34-465f-988a-8633109b8c4c req-a8f2415b-6a52-4e16-b428-b8087b1164c6 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:28.330993 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-364b56ec-db34-465f-988a-8633109b8c4c req-a8f2415b-6a52-4e16-b428-b8087b1164c6 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:28.342263 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-364b56ec-db34-465f-988a-8633109b8c4c req-a8f2415b-6a52-4e16-b428-b8087b1164c6 service nova] Creating event network-vif-deleted:56451a8d-3048-44a7-b7ab-e2d415fa3160 for instance e0ac6b7a-a490-4480-856f-bb49226bf74b on hv-cinder-84175 May 13 14:07:28.347041 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:28.347675 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-364b56ec-db34-465f-988a-8633109b8c4c req-a8f2415b-6a52-4e16-b428-b8087b1164c6 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032584 May 13 14:07:28.348663 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 594/1172] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:07:28.355353 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-6cd97004-db5d-42ed-8efc-e4a32729174d tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 200 len: 1458 microversion: 2.1 time: 0.241768 May 13 14:07:28.355937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 579/1173] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:28 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 1458 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:29.373180 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:29.373802 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: e0ac6b7a-a490-4480-856f-bb49226bf74b] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:29.380806 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:29.381264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:29.382045 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:29.382489 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:29.395732 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] HTTP exception thrown: Instance e0ac6b7a-a490-4480-856f-bb49226bf74b could not be found. May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Request method failure captured: May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b HTTP/1.1 May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmQ54ptFvSdWAAnE_OGlh3GK0K68_2nsI80RShqAxWJsef2riFTjB7STBKP2vmec9bePAskGvlNupLKYgSsFLmF7RaHulJpPfyswEOV9j24XGe6aMCrecu6MYbDJAoshSGKCvxSuqEvkskqiSaJi_f8mkj0tctUIqlUkcKRe_NhLO-4 May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:07:29.397380 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-TestVolumeBootPattern-462252894 May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a27e83f9f5fb4a0b99e7fac6ab90b3e4 May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance e0ac6b7a-a490-4480-856f-bb49226bf74b could not be found. May 13 14:07:29.399198 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'e0ac6b7a-a490-4480-856f-bb49226bf74b'} May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0ac6b7a-a490-4480-856f-bb49226bf74b could not be found. May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:29.400355 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0ac6b7a-a490-4480-856f-bb49226bf74b could not be found. May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0ac6b7a-a490-4480-856f-bb49226bf74b could not be found. May 13 14:07:29.401994 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:29.403647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Returning 404 to user: Instance e0ac6b7a-a490-4480-856f-bb49226bf74b could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:29.403647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d994f91c-3959-4545-a1c1-8c2da23352f4 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b" status: 404 len: 111 microversion: 2.1 time: 0.030415 May 13 14:07:29.403647 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 595/1174] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:29 2022] GET /compute/v2.1/servers/e0ac6b7a-a490-4480-856f-bb49226bf74b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:32.476049 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:32.476625 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:32.483111 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-829fa284-8a23-41e3-9e96-05af7cc9d52b req-a777b472-6812-4c00-84da-4e1e9ac3fa40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b8fc32b-674b-4112-bea2-ca2a5c3ce812", "tag": "f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:32.492997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:32.493393 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:32.494120 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-829fa284-8a23-41e3-9e96-05af7cc9d52b req-a777b472-6812-4c00-84da-4e1e9ac3fa40 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:32.494265 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:32.494572 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-829fa284-8a23-41e3-9e96-05af7cc9d52b req-a777b472-6812-4c00-84da-4e1e9ac3fa40 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:32.494726 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:32.507069 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-829fa284-8a23-41e3-9e96-05af7cc9d52b req-a777b472-6812-4c00-84da-4e1e9ac3fa40 service nova] Creating event network-changed:f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7 for instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 on hv-cinder-84175 May 13 14:07:32.512387 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-829fa284-8a23-41e3-9e96-05af7cc9d52b req-a777b472-6812-4c00-84da-4e1e9ac3fa40 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032905 May 13 14:07:32.513332 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 596/1175] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:32.524608 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Going to try to terminate instance {{(pid=123511) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:07:32.621481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-8a029f97-2ba1-4732-9a31-dfac8443fe0c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "DELETE /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 204 len: 0 microversion: 2.1 time: 0.149087 May 13 14:07:32.622362 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 580/1176] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:07:32 2022] DELETE /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:07:32.633721 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:32.635302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:32.644165 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:32.646239 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:32.647155 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:32.647656 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:32.812383 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:32.821452 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d1ad688c-83f0-4ce3-bae6-fa789d6e3346 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1575 microversion: 2.1 time: 0.194478 May 13 14:07:32.821952 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 597/1177] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:32 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1575 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:33.838839 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:33.839965 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:33.846349 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:33.846900 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:33.847676 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:33.848109 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:33.982214 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:33.989647 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c8026caf-4f67-4672-b9b2-c7d0a1b5e23c tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1575 microversion: 2.1 time: 0.155012 May 13 14:07:33.990811 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 581/1178] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:33 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:34.829790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-f1661105-ba74-4f0f-9f09-e1bdeddb50fc req-7b3c928a-67e4-4e27-90b0-f7a62c957a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b8fc32b-674b-4112-bea2-ca2a5c3ce812", "name": "network-vif-deleted", "tag": "f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:07:34.848294 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-f1661105-ba74-4f0f-9f09-e1bdeddb50fc req-7b3c928a-67e4-4e27-90b0-f7a62c957a31 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:34.848959 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-f1661105-ba74-4f0f-9f09-e1bdeddb50fc req-7b3c928a-67e4-4e27-90b0-f7a62c957a31 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:34.868055 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-f1661105-ba74-4f0f-9f09-e1bdeddb50fc req-7b3c928a-67e4-4e27-90b0-f7a62c957a31 service nova] Creating event network-vif-deleted:f84b4fcf-2b73-474d-95c2-4f6dbc35c2a7 for instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 on hv-cinder-84175 May 13 14:07:34.874069 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-f1661105-ba74-4f0f-9f09-e1bdeddb50fc req-7b3c928a-67e4-4e27-90b0-f7a62c957a31 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050112 May 13 14:07:34.874728 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 598/1179] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:07:35.007218 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:35.007831 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:35.014129 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:35.014585 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:35.015388 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:35.015829 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:35.078997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a27e83f9f5fb4a0b99e7fac6ab90b3e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbbf18059349404c9ed7f53c5b38d2fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:07:35.086957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c837f3a3-79aa-4841-af39-1096e9dbd365 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 200 len: 1224 microversion: 2.1 time: 0.083446 May 13 14:07:35.087551 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 582/1180] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:35 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:07:36.104696 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:36.105428 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: 3b8fc32b-674b-4112-bea2-ca2a5c3ce812] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:36.112016 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.112465 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.113227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.113659 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.129268 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] HTTP exception thrown: Instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 could not be found. May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Request method failure captured: May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 HTTP/1.1 May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmQ54ptFvSdWAAnE_OGlh3GK0K68_2nsI80RShqAxWJsef2riFTjB7STBKP2vmec9bePAskGvlNupLKYgSsFLmF7RaHulJpPfyswEOV9j24XGe6aMCrecu6MYbDJAoshSGKCvxSuqEvkskqiSaJi_f8mkj0tctUIqlUkcKRe_NhLO-4 May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:07:36.130919 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a27e83f9f5fb4a0b99e7fac6ab90b3e4 May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 could not be found. May 13 14:07:36.132742 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': '3b8fc32b-674b-4112-bea2-ca2a5c3ce812'} May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 could not be found. May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:36.133941 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 could not be found. May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 could not be found. May 13 14:07:36.135975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.137515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Returning 404 to user: Instance 3b8fc32b-674b-4112-bea2-ca2a5c3ce812 could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:36.137515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-de3cc7b8-a488-4042-b6d8-894682954861 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812" status: 404 len: 111 microversion: 2.1 time: 0.031803 May 13 14:07:36.137515 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 599/1181] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:36 2022] GET /compute/v2.1/servers/3b8fc32b-674b-4112-bea2-ca2a5c3ce812 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:36.597207 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:36.597757 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:36.604701 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.605147 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.605909 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.606345 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.620070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] HTTP exception thrown: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Request method failure captured: May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: DELETE /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a HTTP/1.1 May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmQ54ptFvSdWAAnE_OGlh3GK0K68_2nsI80RShqAxWJsef2riFTjB7STBKP2vmec9bePAskGvlNupLKYgSsFLmF7RaHulJpPfyswEOV9j24XGe6aMCrecu6MYbDJAoshSGKCvxSuqEvkskqiSaJi_f8mkj0tctUIqlUkcKRe_NhLO-4 May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:07:36.621728 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: a27e83f9f5fb4a0b99e7fac6ab90b3e4 May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.623476 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'af879bc4-815b-4dc1-ad35-0b280ad94c3a'} May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:36.624562 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.626172 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:07:36.627974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Returning 404 to user: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:36.627974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-0135a9d4-9cd6-4f17-88ad-039b58444cd9 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "DELETE /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 404 len: 111 microversion: 2.1 time: 0.029809 May 13 14:07:36.627974 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 583/1182] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:07:36 2022] DELETE /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:36.632204 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:36.632817 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] [instance: af879bc4-815b-4dc1-ad35-0b280ad94c3a] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:07:36.639015 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.639459 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.640266 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:07:36.640697 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:07:36.654551 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.wsgi [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] HTTP exception thrown: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Request method failure captured: May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: request: GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a HTTP/1.1 May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept: application/json May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Accept-Encoding: identity May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Connection: close May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Length: 0 May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Content-Type: application/json May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Host: 10.222.0.79 May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Openstack-System-Scope: None May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: User-Agent: python-urllib3/1.26.9 May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Auth-Token: gAAAAABifmQ54ptFvSdWAAnE_OGlh3GK0K68_2nsI80RShqAxWJsef2riFTjB7STBKP2vmec9bePAskGvlNupLKYgSsFLmF7RaHulJpPfyswEOV9j24XGe6aMCrecu6MYbDJAoshSGKCvxSuqEvkskqiSaJi_f8mkj0tctUIqlUkcKRe_NhLO-4 May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Id: None May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Domain-Name: None May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Identity-Status: Confirmed May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Is-Admin-Project: True May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Id: default May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Domain-Name: Default May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Project-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Role: reader,member May 13 14:07:36.656114 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Roles: reader,member May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_fbbf18059349404c9ed7f53c5b38d2fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Id: fbbf18059349404c9ed7f53c5b38d2fd May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-Tenant-Name: tempest-TestVolumeBootPattern-462252894 May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Id: default May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Domain-Name: Default May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Id: a27e83f9f5fb4a0b99e7fac6ab90b3e4 May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: X-User-Name: tempest-TestVolumeBootPattern-462252894-project May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: method: > May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: exception: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.657779 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: action_args: {'id': 'af879bc4-815b-4dc1-ad35-0b280ad94c3a'} May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:07:36.659537 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. May 13 14:07:36.661160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: ERROR nova.api.openstack.wsgi May 13 14:07:36.662672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Returning 404 to user: Instance af879bc4-815b-4dc1-ad35-0b280ad94c3a could not be found. {{(pid=123512) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:07:36.662672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-41e2eca0-6c25-4ec5-be2f-d56960991c70 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a" status: 404 len: 111 microversion: 2.1 time: 0.029656 May 13 14:07:36.662672 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 600/1183] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:07:36 2022] GET /compute/v2.1/servers/af879bc4-815b-4dc1-ad35-0b280ad94c3a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:07:36.785973 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:07:36.786176 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:07:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:07:37.942461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-3c714fd7-1823-4064-ae9b-f45e531c50a6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] Calling method '.version_select at 0x7fb3be644dc0>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:07:37.960911 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-3c714fd7-1823-4064-ae9b-f45e531c50a6 tempest-TestVolumeBootPattern-462252894 tempest-TestVolumeBootPattern-462252894-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-323121193" status: 202 len: 0 microversion: 2.1 time: 0.022177 May 13 14:07:37.961594 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 584/1184] 10.222.0.79 () {58 vars in 1259 bytes} [Fri May 13 14:07:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-323121193 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:08:20.967666 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:08:20.968269 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:20.974476 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:20.974965 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:20.975744 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:20.976181 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:21.001250 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.objects.instance [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lazy-loading 'flavor' on Instance uuid b219d65a-ac1a-4d2c-8243-253aae77d9d9 {{(pid=123512) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 14:08:21.074363 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2b84d0a7-313d-4426-b82b-5ba923243ab0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "POST /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.107669 May 13 14:08:21.074363 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 601/1185] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:08:20 2022] POST /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:08:21.081417 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:21.082029 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:21.089908 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:21.090480 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:21.091287 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:21.091729 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:21.243823 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:21.251602 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-7446b9e1-354c-4dd2-86bf-2de424c36b5e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.174996 May 13 14:08:21.252177 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 585/1186] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:21 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:22.270304 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:22.270947 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:22.277210 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:22.277664 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:22.278438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:22.278913 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:22.409104 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:22.417053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ff6a7202-8577-4e2e-92ab-6080e37a9b89 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.151578 May 13 14:08:22.417609 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 602/1187] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:22 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:08:23.433583 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:23.434196 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:23.440567 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:23.441025 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:23.441794 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:23.442618 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:23.572128 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:23.580000 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-81b05029-da49-4851-a73d-bbe4e3c6b062 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.150343 May 13 14:08:23.580561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 586/1188] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:23 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:24.597547 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:24.598160 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:24.604739 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:24.605212 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:24.605970 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:24.606407 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:24.747996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:24.755556 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-dde4bb98-f69d-4ec4-a41e-53f2e620871e tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.162018 May 13 14:08:24.756117 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 603/1189] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:24 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:25.772857 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:25.773450 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:25.779957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:25.780415 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:25.781188 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:25.781629 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:25.912819 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:25.921271 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-c6c9231c-67d5-4a3e-b2bb-936adc55950f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.152226 May 13 14:08:25.921854 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 587/1190] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:25 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:26.938302 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:26.938949 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:26.945339 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:26.945790 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:26.948305 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:26.948771 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:27.082834 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:27.091089 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-d4689c2f-2cdd-4c2c-b075-92581509e449 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.156628 May 13 14:08:27.091668 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 604/1191] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:26 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:08:28.108715 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:28.109337 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:28.115711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:28.116163 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:28.116937 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:28.117379 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:28.248603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:28.255994 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-97447176-cc11-4242-be93-2eb7864ac52a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.151238 May 13 14:08:28.256566 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 588/1192] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:28 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:29.273267 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:29.273824 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:29.280841 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:29.281295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:29.282062 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:29.282500 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:29.410012 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:29.417951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-f07f99a6-4deb-4155-92f8-8b201871eeb0 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.148686 May 13 14:08:29.418513 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 605/1193] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:29 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:30.435157 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:30.435808 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:30.442226 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:30.442681 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:30.443486 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:30.443925 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:30.576575 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:30.584390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-18b1338f-48a1-4380-8d95-9caf487b91ee tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.153094 May 13 14:08:30.584957 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 589/1194] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:30 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:31.601488 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:31.602158 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:31.609540 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:31.610002 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:31.610821 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:31.611270 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:31.824884 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:31.832393 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-6d587a8b-9366-49df-8b9f-4f227cb3e974 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.234773 May 13 14:08:31.832975 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 606/1195] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:31 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:32.849561 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:32.850163 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:32.856604 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:32.857058 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:32.857837 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:32.858277 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:32.990649 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:32.998557 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-4e3ad225-8e4a-49d6-b78b-f593bd211c85 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.152902 May 13 14:08:32.999157 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 590/1196] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:32 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:34.015347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:34.015955 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:34.022371 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:34.022856 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:34.023620 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:34.024743 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:34.155511 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:34.162945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-eafe251a-24a6-4f04-8192-788c6b9c51b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1569 microversion: 2.1 time: 0.151379 May 13 14:08:34.163510 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 607/1197] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:34 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:34.179885 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:08:34.180689 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:34.187614 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:34.188066 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:34.188838 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:34.189279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:34.263514 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-ab7becdb-369b-43c7-a98c-2e75e5e44ce5 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "POST /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9/action" status: 202 len: 0 microversion: 2.1 time: 0.087508 May 13 14:08:34.264119 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 591/1198] 10.222.0.79 () {60 vars in 1277 bytes} [Fri May 13 14:08:34 2022] POST /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:08:34.272337 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:34.273053 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:34.279075 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:34.279527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:34.280301 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:34.280738 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:34.436575 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:34.444346 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-65ba4a3e-7c31-4958-b57b-0412dad6a5c6 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1577 microversion: 2.1 time: 0.175998 May 13 14:08:34.444911 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 608/1199] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:34 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:35.461826 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:35.463070 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:35.469481 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:35.469936 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:35.470755 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:35.471209 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:35.610232 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:35.617753 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-e3538611-d9fa-4c3b-ac78-9d628f3f1390 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1519 microversion: 2.1 time: 0.160409 May 13 14:08:35.618321 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 592/1200] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:35 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1519 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:36.635376 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:36.635931 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:36.642755 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:36.643379 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:36.644191 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:36.644640 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:36.897527 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:36.905596 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7381e298-ec9a-48e2-9a29-922eee25d1bc tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.274221 May 13 14:08:36.906177 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 609/1201] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:36 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:37.153997 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-13c899f9-1a96-4ec4-838b-ef1fa8f28bab req-f8d34c7a-d98c-4b2a-b75d-f77c6794ebc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "name": "network-vif-unplugged", "status": "completed", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:08:37.167863 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-13c899f9-1a96-4ec4-838b-ef1fa8f28bab req-f8d34c7a-d98c-4b2a-b75d-f77c6794ebc2 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:37.168286 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-13c899f9-1a96-4ec4-838b-ef1fa8f28bab req-f8d34c7a-d98c-4b2a-b75d-f77c6794ebc2 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:37.180721 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-13c899f9-1a96-4ec4-838b-ef1fa8f28bab req-f8d34c7a-d98c-4b2a-b75d-f77c6794ebc2 service nova] Creating event network-vif-unplugged:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:08:37.186779 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-13c899f9-1a96-4ec4-838b-ef1fa8f28bab req-f8d34c7a-d98c-4b2a-b75d-f77c6794ebc2 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.099354 May 13 14:08:37.187390 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 593/1202] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:08:37.923347 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:37.923966 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:37.930162 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:37.930621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:37.931945 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:37.932385 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:38.071161 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:38.079442 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-fa8c6806-2b9a-44d1-87f4-71c2ed0ef788 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.160755 May 13 14:08:38.080021 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 610/1203] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:37 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 14:08:39.099346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:39.100288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:39.106917 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:39.107375 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:39.108156 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:39.108598 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:39.244688 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:39.252144 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-2152ef1a-b49f-4fc5-9a9e-8f3cb7b0a088 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.158111 May 13 14:08:39.252713 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 594/1204] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:39 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:40.270227 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:40.271064 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:40.278997 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:40.279512 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:40.280330 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:40.280772 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:40.423883 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:40.432116 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-7e1486b9-8c9d-45f3-b8dc-b6225c0ee92f tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.165871 May 13 14:08:40.432695 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 611/1205] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:40 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:41.451030 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:41.451645 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:41.458035 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:41.458489 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:41.459304 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:41.459746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:41.597445 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:41.605763 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-f2d11e83-91d0-420a-8bcb-f9c97ae83141 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.158565 May 13 14:08:41.606363 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 595/1206] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:41 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:42.623429 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:42.624131 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:42.630691 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:42.631172 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:42.631951 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:42.632395 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:42.765510 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:42.773318 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-1953465d-fa19-4629-afcc-da156feb95b2 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.154770 May 13 14:08:42.773928 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 612/1207] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:42 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:43.791279 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:43.791943 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:43.798336 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:43.798813 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:43.799603 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:43.800034 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:43.934223 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:43.941876 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-449ec901-de03-43b8-8718-c92370eae5bf tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1575 microversion: 2.1 time: 0.154632 May 13 14:08:43.942440 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 596/1208] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:43 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:44.959627 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:08:44.960372 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:08:44.968274 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:44.968714 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:44.969492 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:44.969924 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:45.114858 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:08:45.122744 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-2ad36e69-6dd0-4b42-bbbc-aad7c4fc5bf8 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1562 microversion: 2.1 time: 0.167081 May 13 14:08:45.123328 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 613/1209] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:08:44 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1562 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:08:47.218346 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-2793eb52-44aa-4e21-9512-1384cc82bf6b req-59c0be27-a8e1-4617-b4ad-ca04d84af4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "name": "network-vif-plugged", "status": "completed", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:08:47.227260 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-2793eb52-44aa-4e21-9512-1384cc82bf6b req-59c0be27-a8e1-4617-b4ad-ca04d84af4bc service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:08:47.227711 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-2793eb52-44aa-4e21-9512-1384cc82bf6b req-59c0be27-a8e1-4617-b4ad-ca04d84af4bc service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:08:47.247252 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-2793eb52-44aa-4e21-9512-1384cc82bf6b req-59c0be27-a8e1-4617-b4ad-ca04d84af4bc service nova] Creating event network-vif-plugged:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:08:47.253650 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-2793eb52-44aa-4e21-9512-1384cc82bf6b req-59c0be27-a8e1-4617-b4ad-ca04d84af4bc service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038557 May 13 14:08:47.254288 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 597/1210] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:09:59.616246 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [req-52e2d6d8-40dc-49a1-94c6-f6e9f2edfeee req-7544ed68-4197-48fb-b6a5-671c4f1a991c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:09:59.620713 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:09:59.621295 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:09:59.628710 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-52e2d6d8-40dc-49a1-94c6-f6e9f2edfeee req-7544ed68-4197-48fb-b6a5-671c4f1a991c service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:09:59.629152 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:09:59.629359 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [req-52e2d6d8-40dc-49a1-94c6-f6e9f2edfeee req-7544ed68-4197-48fb-b6a5-671c4f1a991c service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:09:59.629621 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:09:59.630819 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:09:59.631226 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:09:59.642071 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.compute.server_external_events [req-52e2d6d8-40dc-49a1-94c6-f6e9f2edfeee req-7544ed68-4197-48fb-b6a5-671c4f1a991c service nova] Creating event network-changed:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:09:59.647322 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [req-52e2d6d8-40dc-49a1-94c6-f6e9f2edfeee req-7544ed68-4197-48fb-b6a5-671c4f1a991c service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036167 May 13 14:09:59.648261 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 598/1211] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 14:09:59.661589 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Going to try to terminate instance {{(pid=123512) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 14:09:59.745468 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ab3b8be0-828b-4e4d-93a8-571e5ffb257a tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "DELETE /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 204 len: 0 microversion: 2.1 time: 0.139328 May 13 14:09:59.746060 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 614/1212] 10.222.0.79 () {58 vars in 1238 bytes} [Fri May 13 14:09:59 2022] DELETE /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 14:09:59.755891 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:09:59.756898 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:09:59.763746 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:09:59.764201 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:09:59.765024 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:09:59.765467 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:09:59.923601 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:09:59.931110 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-cfb4e446-4580-4510-9696-2cc5876fda79 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.179785 May 13 14:09:59.931687 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 599/1213] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:09:59 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:10:00.949996 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:10:00.950746 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.compute.api [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123512) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:10:00.957389 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:00.957838 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:00.958619 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:00.959088 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:01.088964 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.policy [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123512) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:10:01.097264 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-b83af395-1241-4c06-88d0-60adee8a8b92 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1568 microversion: 2.1 time: 0.151538 May 13 14:10:01.097827 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 615/1214] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:10:00 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:10:02.115204 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:10:02.115914 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:10:02.122413 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:02.122905 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:02.123690 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:02.124818 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:02.330735 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [req-21f649e7-70aa-483b-9e2f-9091dc439c23 req-8996c138-37d9-4247-b486-9b7c13f74f78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b219d65a-ac1a-4d2c-8243-253aae77d9d9", "name": "network-vif-deleted", "tag": "c66ee4e9-1ddb-4706-b552-3352e32b6ea0"}]} {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 14:10:02.341232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-21f649e7-70aa-483b-9e2f-9091dc439c23 req-8996c138-37d9-4247-b486-9b7c13f74f78 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:02.341658 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG oslo_concurrency.lockutils [req-21f649e7-70aa-483b-9e2f-9091dc439c23 req-8996c138-37d9-4247-b486-9b7c13f74f78 service nova] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123512) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:02.345944 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.policy [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ac7988aa0e74fc6b56269d975270d48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54b153696d2b445098e70dce631b13b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=123511) authorize /opt/stack/nova/nova/policy.py:199}} May 13 14:10:02.353804 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-daa23393-58d3-4f29-8537-78888ff81e22 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 200 len: 1449 microversion: 2.1 time: 0.242694 May 13 14:10:02.354366 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.compute.server_external_events [req-21f649e7-70aa-483b-9e2f-9091dc439c23 req-8996c138-37d9-4247-b486-9b7c13f74f78 service nova] Creating event network-vif-deleted:c66ee4e9-1ddb-4706-b552-3352e32b6ea0 for instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 on hv-cinder-84175 May 13 14:10:02.356849 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 600/1215] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:10:02 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 1449 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 14:10:02.360092 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [req-21f649e7-70aa-483b-9e2f-9091dc439c23 req-8996c138-37d9-4247-b486-9b7c13f74f78 service nova] 10.222.0.79 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033426 May 13 14:10:02.360862 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 616/1216] 10.222.0.79 () {64 vars in 1317 bytes} [Fri May 13 14:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 14:10:03.371884 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '>' {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:10:03.372461 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.compute.api [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] [instance: b219d65a-ac1a-4d2c-8243-253aae77d9d9] Fetching instance by UUID {{(pid=123511) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 14:10:03.378896 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:03.379352 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:03.380134 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 14:10:03.380588 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG oslo_concurrency.lockutils [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Lock "bc8b7433-1fad-4f12-b158-7b2f495bcb59" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=123511) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 14:10:03.393623 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.wsgi [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] HTTP exception thrown: Instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 could not be found. May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Request method failure captured: May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: request: GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 HTTP/1.1 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept: application/json May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Accept-Encoding: identity May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Connection: close May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Length: 0 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Content-Type: application/json May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Host: 10.222.0.79 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Openstack-System-Scope: None May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: User-Agent: python-urllib3/1.26.9 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Auth-Token: gAAAAABifmWtE2vbs5oePXvT3UdyOG8cXIlkPJkBIMLCy_tLwiHXCpsuusxPb7eIjDbmDwwJ7muDBDaC-kgd_NFt_hI0gETk2LEGULH-abvkWfP4L2GuE5HcPr_-QjkB_3q2-pE__lOIFV_gZUdgDriA9PIR93aNSRiZs-YMF2QAC2RrLdRls10 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Id: None May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Domain-Name: None May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Identity-Status: Confirmed May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Is-Admin-Project: True May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Id: default May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Domain-Name: Default May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Id: 54b153696d2b445098e70dce631b13b6 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Project-Name: tempest-TestShelveInstance-1278664490 May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Role: reader,member May 13 14:10:03.395290 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Roles: reader,member May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/54b153696d2b445098e70dce631b13b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/volume/v3/54b153696d2b445098e70dce631b13b6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/compute/v2/54b153696d2b445098e70dce631b13b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.79:8080", "publicURL": "http://10.222.0.79:8080/v1/AUTH_54b153696d2b445098e70dce631b13b6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.79/image"}]}] May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant: tempest-TestShelveInstance-1278664490 May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Id: 54b153696d2b445098e70dce631b13b6 May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-Tenant-Name: tempest-TestShelveInstance-1278664490 May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User: tempest-TestShelveInstance-1278664490-project May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Id: default May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Domain-Name: Default May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Id: 4ac7988aa0e74fc6b56269d975270d48 May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: X-User-Name: tempest-TestShelveInstance-1278664490-project May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: method: > May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: exception: Instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 could not be found. May 13 14:10:03.397072 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: action_args: {'id': 'b219d65a-ac1a-4d2c-8243-253aae77d9d9'} May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: {{(pid=123511) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 could not be found. May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 14:10:03.398106 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 could not be found. May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 could not be found. May 13 14:10:03.399797 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: ERROR nova.api.openstack.wsgi May 13 14:10:03.401294 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: DEBUG nova.api.openstack.wsgi [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Returning 404 to user: Instance b219d65a-ac1a-4d2c-8243-253aae77d9d9 could not be found. {{(pid=123511) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 14:10:03.401294 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO nova.api.openstack.requestlog [None req-d3fc5f8b-19af-4f75-b275-ca02778a2890 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9" status: 404 len: 111 microversion: 2.1 time: 0.029194 May 13 14:10:03.401294 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: [pid: 123511|app: 0|req: 601/1217] 10.222.0.79 () {58 vars in 1235 bytes} [Fri May 13 14:10:03 2022] GET /compute/v2.1/servers/b219d65a-ac1a-4d2c-8243-253aae77d9d9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 14:10:03.561778 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: DEBUG nova.api.openstack.wsgi [None req-ae57821e-20e7-42ae-93d1-0bf86448d528 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] Calling method '.version_select at 0x7fb3bdd18af0>' {{(pid=123512) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 14:10:03.584588 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO nova.api.openstack.requestlog [None req-ae57821e-20e7-42ae-93d1-0bf86448d528 tempest-TestShelveInstance-1278664490 tempest-TestShelveInstance-1278664490-project] 10.222.0.79 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1976190613" status: 202 len: 0 microversion: 2.1 time: 0.026838 May 13 14:10:03.585501 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: [pid: 123512|app: 0|req: 617/1218] 10.222.0.79 () {58 vars in 1253 bytes} [Fri May 13 14:10:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1976190613 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 14:10:56.795341 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:10:56.795892 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:10:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:11:27.466438 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:11:27.467132 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Fri May 13 14:11:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:12:44.989919 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:12:44.990427 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:12:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:12:51.579350 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:12:51.579992 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Fri May 13 14:12:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:12:58.753206 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:12:58.753914 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:12:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:13:14.000721 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:13:14.001232 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Fri May 13 14:13:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:14:16.804650 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:14:16.805344 dv-cinder-841753-1-iscsi devstack@n-api.service[123511]: Fri May 13 14:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 14:14:47.475751 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 14:14:47.476409 dv-cinder-841753-1-iscsi devstack@n-api.service[123512]: Fri May 13 14:14:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!